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An overview is given of recent advances in nonequilibrium statistical mechanics on the basis of the 
theory of Hamiltonian dynamical systems and in the perspective provided by the nanosciences. It is 
shown how the properties of relaxation toward a state of equilibrium can be derived from Liouville's 
equation for Hamiltonian dynamical systems. The relaxation rates can be conceived in terms of 
the so-called Pollicott-Ruelle resonances. In spatially extended systems, the transport coefficients 
can also be obtained from the Pollicott-Ruelle resonances. The Liouvillian eigenstates associated 
with these resonances are in general singular and present fractal properties. The singular character 
of the nonequilibrium states is shown to be at the origin of the positive entropy production of 
nonequilibrium thermodynamics. Furthermore, large-deviation dynamical relationships are obtained 
which relate the transport properties to the characteristic quantities of the microscopic dynamics 
such as the Lyapunov exponents, the Kolmogorov-Sinai entropy per unit time, and the fractal 
dimensions. We show that these large-deviation dynamical relationships belong to the same family 
of formulas as the fluctuation theorem, as well as a new formula relating the entropy production 
to the difference between an entropy per unit time of Kolmogorov-Sinai type and a time-reversed 
entropy per unit time. The connections to the nonequilibrium work theorem and the transient 
fluctuation theorem are also discussed. Applications to nanosystems are described. 



I. INTRODUCTION 



Traditionally, statistical mechanics deals with macroscopic systems containing a number of particles equal to the 
Avogadro number N\ = 6.02 2 1 4 1 5 x 10 23 . However, this number has an anthropocentric origin since it relates the 
atoms to human artefacts such as the kilogram. Therefore, the Avogadro number does not represent a fundamental 
scale with respect to the atoms (except perhaps in biology). The question remains of the scale at which a phenomenon 
admits a statistical description. In this regard, statistical mechanics is currently challenged by the nanosciences which 
provide many examples of systems - often out of equilibrium - of size intermediate between the atoms and the 
macrosystems and which clearly require a statistical description. Examples of such nanosystems are the following: 

• Electronic transport in semiconducting quantum dots, as well as molecules, conducting polymers, or carbon 
nanotubes of a few dozen to hundred of nanometers where the conductance is given by the Landaucr-Buttiker 
formula. 

• Quantum corrals of 10-20 nm built with the scanning tunneling microscope (STM) by positioning iron atoms 
on the surface of copper at 4 K 0,0. 

• Diffusion of atoms and molecules on surfaces studied by field ion microscopy (FIM) and STM 0, IU, El • 

• Atomic and molecular clusters with diameters of a few nanometers such as Na„ where melting has been studied 
as a function of the size n Q • 

• Large molecules such as polymers and RNA molecules studied thanks to atomic force microscopy (AFM) and 
optical tweezers 0, @ • 

• Rotary nanomotors of about 10 -18 Watt have been constructed by isolating the Fi-ATPase protein complex 



from mitochondria and gluing an actin filament or a gold bead to the axis of the motor 
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• Artificial electric motors of the size of about 300 nm manufactured with an axis made of a multiwalled carbon 
nanotube 0,0]. The carbon nanotube plays the role of a bearing for the motor. This bearing is characterized 
by dynamic friction which dissipates energy. Energy is also dissipated by dynamic friction in the telescoping 
translational motion of multiwalled carbon nanotube 0, 0] . 

• The active motion of nanodroplets on surfaces covered by tensio-active chemical reactants [T^. Il7| . 
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• Oscillating reactions at nanometric tips of field electron (FEM) and field ion (F1M) microscopes 01- These 
chemical clocks are the nanometric analogues of the macroscopic Belousov-Zhabotinsky oscillating reaction. 

One of the most fascinating recent results from the nanosciences is that self-organization can already manifest 
itself at the scale of a few nanometers and this under both equilibrium or nonequilibrium conditions. The Glansdorff- 
Prigogine dissipative structures showed that self-organization is possible in macroscopic systems under nonequilibrium 
constraints, such as the Rayleigh-Benard convection rolls and Turing patterns in the Belousov-Zhabotinsky chemical 
reaction |19j . Recent discoveries in nanosciences show that the structuration and complexification of matter already 
start at the nanoscale. The formation of micelles of about 10 nm in liquid mixtures or nanoclusters of similar sizes 
at solid-gas or solid-liquid interfaces are examples of self-organization at the nanoscale. The micelles or interfacial 
nanoclusters already exist as equilibrium structures of colloidal phases, but their formation by nucleation from a 
homogeneous phase is a typical nonequilibrium process. It is clear that the biological world has taken advantage of 
such structuration mechanisms to build up self-reproducible compartimentized organisms with an internal metabolism. 
The biological metabolism is a nonequilibrium property which provides the organism with a relative autonomy with 
respect to its environment. The wonderful discoveries of biology clearly show that the complexification starts at the 
scale just above the size of atoms by the formation of biomolecules, proteins, RNA, DNA, which themselves self- 
assemble into supramolecular structures such as ribosomes, nanomotors, membranes, virus, organelles, bacteria, etc. 
Similar structurations without metabolism and self-reproduction exists at the nanoscale in the inorganic world with 
the fullerenes C n , the nanotubes of carbon, of vanadium oxides, or silicate minerals like chrysotile, and the zeolites 
as a few examples. 

These results provide a perspective very different from the traditional view which divides the realm of interest into 
the microscopic world of atoms, on the one hand, and the macroscopic world of bulk phases, on the other hand. 
The new perspective provided by the nanosciences urges the development of statistical physics in order to explain the 
equilibrium and nonequilibrium properties of the intermediate structures. The understanding of the onset of biological 
organization is here a future fundamental challenge. Of immediate interest is the formulation of theoretical schemes 
able to deal with equilibrium and nonequilibrium nanosystems. We are here at the interface between dynamical 
systems theory and traditional statistical mechanics. Indeed, nanosystems may be sufficiently small to be considered 
as dynamical systems in which the motion of the particles is described by Newton's equations and large enough for the 
onset of statistical behaviors such as friction, diffusion, viscosity, and sustained nonequilibrium motions or oscillations. 
The link between dynamical systems theory and statistical mechanics is thus of immediate interest for nanosciences. 
Many studies indeed show that statistical behavior starts to emerge already in relatively small systems containing 
dozen, hundred, or thousand particles depending on the property of concern. For instance, the transport coefficients 
can be calculated in hard-ball systems with a few dozen particles |2E 0] and the Rayleigh-Benard convection rolls 
can be simulated by molecular dynamics in systems of several thousand particles [22| . 

Of fundamental interest are the new concepts coming from dynamical systems theory |23j and which have changed 
our perspective about irreversibility and the second law of thermodynamics. Indeed, the study of chaotic systems in 
the late eighties and early nineties have introduced new types of relationships within nonequilibrium physics. These 
new relationships concern the large deviations or large fluctuations that the dynamical properties of a system may 
undergo during the time evolution. In the escape-rate formalism, these large-deviation relationships have first been 
discovered between microscopic quantities such as the Lyapunov exponents and the Kolmogorov-Sinai entropy per 
unit time and the transport coefficients, establishin g fu ndamental connections between the microscopic dynamics 
and the irreversible properties of the system 0, HE HE HE HE HE HE| ■ The Lyapunov exponents characterize the 
sensitivity to initial conditions of the underlying microscopic dynamics while the Kolmogorov-Sinai entropy per unit 
time measures the degree of dynamical randomness developed by the trajectories of the system during their time 
evolution. Thereafter, these large-deviation relationshi ps w ere extended to other situations and become known under 
the name of the fluctuation theorem [MIMIMHIMIMEESIMIIEIII Historically, this theorem came 
out of discussions during the conference organized in Sardinia in July 1991 where the importance and generality of 
these large-deviation relationships became evident Today, these relationships have significantly changed our 

understanding of the second law of thermodynamics by showing how to formulate entropy production in fluctuating 
systems, in particular, at the nanoscale @. In the way, systematic methods have been developed to carry out the ab 
initio derivation of the transport properties and the entropy production of nonequilibrium thermodynamics from the 
underlying Hamiltonian dynamics. 

The purpose of these lecture notes is to describe these new developments. In Sec. [H] the statistical description is 
formulated in terms of Liouville's equation for Hamiltonian systems. We show how to extract the instrinsic relaxation 
rates from this equation after suitable assumptions on the dynamics of the system. Liouville's equation also lead to the 
master or kinetic equations which provide intermediate and efficient description of the time evolution. The concepts 
of Lyapunov exponents and Kolmogorov-Sinai entropy per unit time are presented in Sec. [H] Section [IIII is devoted to 
the escape-rate formalism where a first large-deviation relationship is derived which relates the transport coefficients 
to the characteristic quantities of the underlying microscopic dynamics. In Sec. IIVI we carry out the construction 
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of the hydrodynamic modes in the case of diffusion and we show how the entropy production of nonequilibrium 
thermodynamics can be derived from the underlying Hamiltonian dynamics. The properties of the diffusive modes 
such as their fractal character are here given by further large-deviation relationships very similar to the one of the 
escape-rate formalism. In Sec. we proceed with systems maintained out of equilibrium by fluxes of matter and 
energy and described by master equations. The fluctuation theorem and some of its consequences are derived in 
this framework. The connections to the escape-rate formula [HI , the nonequilibrium work relations j^S E3| > and the 
transient fluctuation theorem |32ll44| are discussed. In Sec. I VII a new large-deviation relationship is presented which 
relates entropy production to the difference between a newly introduced time-reversed entropy per unit time |45j and 
the usual entropy per unit time as previously introduced by Shannon, Kolmogorov, and Sinai. This new relationship 
provides us with a new interpretation of the second law. Applications to nanosystems are given in Sec. IV11I where 
we deal with friction in carbon nanotubes, biological nanomotors, and oscillating chemical reactions at the nanoscale. 
Conclusions are drawn in Sec. IVIIII 

II. DYNAMICAL SYSTEMS THEORY 

A. Hamiltonian dynamics and the statistical description 

At the microscopic level of description, the natural systems are composed of particles with a position, an momentum, 
and possibly a spin. 

Let us consider an isolated system, which is a system isolated from the external world since its initial preparation. 
Examples are provided by atomic and molecular clusters 0. In classical mechanics, the positions and momenta evolve 
in time t according to Hamilton's equation 

dv a _ + dH_ dpa _ _dH_ ,^ 

dt dpa dt dr a 

The space to which the positions and momenta belong is called the phase space: T — (ri,pi,r2,p2, ■■■?n,Pn) G M.- 
The number of degrees of freedom is the dimension of the position space / = Nd. The dimension of the phase space 
is equal to twice this number: M = dim.M = 2/ = 2Nd. For a non-relativistic system without magnetic field, the 
Hamiltonian function is given by 

N 2 

H = E£r + c/ ( r i' r 2<"< r ^) ( 2 ) 

a— 1 a 

which leads to Newton's equations in terms of the forces F a = —d r JJ. The Hamiltonian time evolution has the 
property to preserve the phase-space volumes, dT — dr\dpidr2dp2---drNdpN , which is known as Liouville's theorem. 
This property originates from the unitarity of the underlying quantum mechanics. Systems invariant under continuous 
symmetries such as time or spatial translations, or rotations have constants of motion such as the total energy E = H . 
The time evolution is symmetric under time reversal 

6(ri,pi,r 2 ,P2, ...rjv,pjv) = Oi, -pi, r 2 , -p 2 , ...r N , -pjv) (3) 

if the Hamiltonian function is an even function of the momenta. This is the case for the electromagnetic force ruling 
the interactions between the atoms and molecules. 

Hamilton's equations determine the trajectories of the system from the initial conditions on the positions and 
momenta. The uniqueness of the trajectories is guaranteed by Cauchy's theorem if the Hamiltonian function is 
sufficiently smooth, which is the basis of determinism. Cauchy's theorem defines a flow in the phase space, T — & (To), 
which is the one-parameter Abelian group of time evolution. 

However, the Newtonian scheme leaves open the determination of the initial conditions which can take any value 
depending on our experimental abilities to manipulate the system. The preparation of initial conditions is never the 
feature of the system left alone without external intervention. Typically, this preparation involves a larger system 
including the system itself with the preparing device, which is not described by Hamilton's equations ft). Of course, 
there is no doubt that this larger system also admits a Newtonian description but again the preparation of its initial 
conditions would require a still larger system. The natural systems for which nearly perfect initial conditions can be 
determined are particles such as photons, electrons, atoms, or even molecules prepared by the formation of beams such 
as laser beams or molecular beams or by the confinement and relaxation of particles in traps. Such devices provide a 
nearly perfect reproducibility of the initial state. However, the reproducibility is never perfect and the initial conditions 
always differ from one experiment to the next even if the experimental conditions are under the best possible control 
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of reproducibility. Accordingly, a statistical analysis of the initial conditions is required for instance by looking for the 
frequency at which such and such positions and momenta occur during successive otherwise identical experiments. 
The distribution of initial conditions is thus described by the probability density po(T) = Po( r i, Pi, r 2, P2, — r/v , Pn), 
which describes the statistical ensemble of initial conditions. 

The same problem of initial conditions occurs in the closed systems which are systems with a fixed number of 
particles but in contact with one or several heat reservoirs, as well as the open systems which are systems in contact 
with one or several particles reservoirs. Most of the examples listed in the introduction are open systems. Particles 
may enter and exit at the boundaries of an open system. The income of particles depends on the environment and 
is typically undetermined from the inside. The position and momentum of a particle is thus fixed at the moment 
of its entrance and its trajectory takes place inside the system till the exit of the particle. The exit is determined 
by the conditions at the entrance but these later typically differ from particle to particle so that only a statistical 
distribution is required for the description of the influx of particles. A similar reasoning holds for systems in contact 
with heat reservoirs. These systems should be described by random (also called stochastic) boundary conditions. 
A deterministic description can be achieved possibly by including the reservoirs in a larger total system which is 
isolated. However, the reservoirs are typically characterized by a few parameters such as their temperature and 
chemical potentials, which suppose statistical conditions at the boundaries. Therefore, we should expect that the 
need of a statistical description is even more important for closed and open systems. 



B. Dynamical instability 

Nevertheless, the success of celestial mechanics and of the space mission shows that statistical uncertainties on 
the initial conditions do not hamper a description in terms of Hamiltonian trajectories. This question is related 
to the problem of our ability to predict the future state of the system from the knowledge of its initial conditions, 
which depends on the stability or instability of the trajectories. In integrable systems, the constants of motion 
limit the phase-space regions where the trajectories evolve so that nearby trajectories stay close to each other with 
possible dephasing in the direction of the flow. In contrast, chaotic systems present a sensitivity to initial conditions 
of exponential type. Nearby trajectories separate at exponential rates. The rates of separation are the so-called 
Lyapunov exponents |23j . There is one positive Lyapunov exponent for each unstable directions in phase space 

A^lim^ML (4) 
t^oo t \\STi(0)\\ V 1 

where 8Ti(t) denotes the infinitesimal separation between the reference trajectory <& [T(0)] and the perturbed tra- 
jectory $'[r(0) + (51^(0)]. The Lyapunov exponents form a spectrum of exponents ordered from a maximum to a 
minimum value. There are as many Lyapunov exponents as phase-space dimensions M. The symplectic character of 
Hamilton's equal implies that the Lyapunov exponents obey the pairing rule that each negative Lyapunov exponent 
forms a pair with a corresponding positive Lyapunov exponent: {Ai, — HjJ. Liouville's theorem has for conse- 

quence that the sum of all the Lyapunov exponents vanishes: YliLi ^» = 0- Indeed, this sum is the rate of expansion 
of the phase-space volumes. Moreover, a pair of Lyapunov exponents vanishes for each constant of motion because 
there is no exponential separation of trajectories in the phase-space direction of the constant of motion and another 
exponent vanishes by the pairing rule. 

In a chaotic system, the phase-space distance between a reference trajectory and a perturbed trajectory increases 
exponentially at a rate given by the maximum Lyapunov exponent A max . If the initial conditions are known with a 
precision ^initial and if a prediction with a precision £fi na i is required, the time interval of the prediction should not 
exceed a value called the Lyapunov time 

t < t Lyap ~ — !— In £final (5) 

^max ^initial 

The horizon of prediction is thus of the order of magnitude of the inverse of the maximum Lyapunov exponent |46| . 
Beating the Lyapunov time requires an increase in the number of decimals or bits of the initial conditions which goes 
linearly with the time interval requested. In systems with many degrees of freedom this problem is enhanced by the 
dimensionality of the phase space. Indeed, we have an amplification of the initial error in each unstable phase-space 
direction at the rate Xi given by the corresponding Lyapunov exponent. Therefore, the number of decimals known on 
the set of initial conditions should grow at a rate proportional to the sum of positive Lyapunov exponents. 

This growth is slower in systems without exponential sensitivity to initial conditions such as polygonal billiards. 
Elastic reflections on flat walls lead to a separation of trajectories which is a power of time. In a system with / degrees 
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of freedom, the number of decimals on the initial conditions for a prediction after a time interval t should thus grow 
as / logio t- 

The maximum Lyapunov exponent can be estimated in systems of interacting particles by following a reasoning 
first performed by Krylov |4?| . We consider air at temperature T and pressure P as a gas of particles of diameter d, 
the successive collisions of a particle are separated by a distance of the order of the mean free path I ~ l/(nd 2 ) where 
n ~ P/(A;bT) is the density of particles. The intercollisional time r is given by the mean free path divided by the 
mean velocity v ~ \fk^T jm: r ~ I /v. As shown in Fig. ^ some perturbation on the velocity angle Sipj at the j th 
collision is amplified by a factor l/d at the next collision by the defocusing character of the elastic collisions between 
spherical particles. Therefore, the perturbation after j collisions is given by 

Sip j ~ 5tpo (tj) = S<po e Amaxt (6) 

Since the time for j successive collisions is given by t ~ jr, the maximum Lyapunov exponent is estimated to take 
the very high value 

A ~ - In - ~ 10 10 digits sec" 1 (7) 
t d 

for air at room temperature and pressure. 




FIG. 1: Amplification of some perturbation on the velocity angle 6<pj for a particle undergoing two successive collisions separated 
on average with a distance of the order of the mean free path I. The particles have a diameter d. 



The systematic numerical calculation of the spectrum of Lyapunov exponents was undertaken in the eighties and, 
todav, it is a routine calculation to obtain the spectrum of Lyapunov exponents in many-particle systems [48L l4fll 
IHoL fHlL IH^. I5H] . The chaotic property is thus widespread among the systems of statistical mechanics. According to 
Krylov's formula J7J, the Lyapunov time of prediction in such a system is over the order of the intercollisional time, 
i.e., 10 -10 sec/digit in a gas at room temperature and pressure. This very short time scale is in contrast with the very 
long Lyapunov times for chaotic motion in the Solar system. The shortest known is the Lyapunov time of 8.5 10 6 
sec/digit for the rotation of Hyperion p9| . Therefore, we can understand that the statistical description appears 
naturally for the systems of statistical mechanics. 



C. Liouville's equation 



Beyond the time scale of possible trajectory prediction, the statistical ensemble of initial conditions tends to spread 
across large phase-space regions and the physical observables no longer take values which can be approximated by 
individual phase-space points, but values obtained by statistical averages over the statistical ensemble of points. The 
statistical average of a physical observable A(Y) at current time t is given in terms of the ensemble of initial conditions 
r by 

(A) t = J A(&T ) P0 (r Q ) dT Q = J A(T) po(# _t r) dT = J A(T) p t (T) dF (8) 

where we used Liouville's theorem dT = dTo between the initial conditions To and the current phase T = ^Tq. 
Hence, the probability density evolves in time by the application of a linear operator called the Frobenius- Perron 
operator: 



Pt (T) = p* Po (r) =po(*-*r) 



(9) 
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which acts by a simple substitution of the current phase-space position by its preimage under the flow, its preimage 
giving the initial condition of the trajectory. 

The flow locally preserves the probability in phase space so that the probability density obeys the continuity 
equation called Liouville's equation 46]: 

d tP = -div(I» = {H, P } = Lp (10) 
where {•, •} denotes the Poisson bracket. Liouville's equation is linear and defined in terms of the Liouvillan operator 

N 

^dr a dp a dp a dr (l/ 



a=l 

If the system is autonomous, the solution of Liouville's equation takes the form p t = e Lt po — P t po, which shows that 
the Liouvillian operator is the generator of the Frobenius-Perron operator. 

Liouville's equation is a partial differential equation and as such requires boundary conditions to be solved. Typi- 
cally, we consider N particles in a container with elastic reflections on the walls or N particles on a torus as simulated 
by molecular dynamics on computers. However, nothing prevents us to consider other boundary conditions which 
could maintain the system in a nonequilibrium steady state |29|. This can be achieved by considering appropriate 
incoming fluxes at the boundaries of the phase space. The outgoing fluxes would be fixed by causality. The total 
probability within the boundaries dAi of the phase space Ai obeys the balance equation 



— / dTp = - I dA ■ T p = - I dA ■ T p- I dA-Tp (12) 

M JdM J dM in JdMou 

y v 

>o <o 



dt 



where dA denotes an infinitesimal element of the area of the boundary. The vector dA points toward the exterior 
of Ai and is normal to its boundary. The boundary is naturally divided into a part where the vector field T points 
toward the interior of Ai and another to the exterior dAi = cM'linUd./Vlout- A nonequilibrium steady state is obtained 
for flux boundary conditions with p\dM in 0- Such boundary conditions are commonly used in molecular-dynamics 
simulations [54| . Instead, we may assume absorbing boundary conditions with p\dM ln = 0- I n this case, the measure 
of the phase-space region Ai monotonically decreases, which corresponds to the escape of trajectories out of this 
region. Contrary to a first impression, such absorbing boundary conditions lead to nontrivial results of great interest 
for nonequilibrium considerations as shown in the escape-rate formalism. 



D. The ergodic properties 



If the evolution operator of an autonomous system is defined on a Hilbert space of phase-space functions, we can 
define a unitary group of time evolution 

Pt = frpo = exp(-*&) po (13) 

with the Hermitian generator given in terms of the Liouvillian operator by G — iL 56]. The resolvent of the Hermitian 
operator is defined by R(z) = (z — G) _1 where the variable z can be interpreted as a frequency. The unitary operator 
can be recovered from the resolvent by integration in the plane of the complex variable z. In the following, we 
introduce the complex variable s = —iz, which has the interpretation of minus a relaxation or decay rate since 
exp(— izt) = exp(si). We have that Ims = — Rez so that a real frequency is an imaginary decay rate and Res = Imz 
so that an imaginary frequency is a real decay rate. 

The spectrum of the unitary evolution operator IP and of its generator G belongs to the axis Im z = or Re s = 
of the real frequencies. This spectrum may include discrete eigenvalues as well as a continuous spectrum. The ergodic 
properties determine some of the features of the spectrum. 

Around 1887, Boltzmann introduced the property of ergodicity which is today defined by requiring that the time 
average of an observable A(T) is equal to its statistical average with respect to some unique invariant probability 
measure fj, of density 

hm i / A(&r )dt = / ^(r)* (r)dr = (A) (14) 

T— oo 1 Jq J 
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for /^-almost all initial conditions Tq. We notice that the probability density \&o is a stationary solution of Liouville's 
equation i|l(J|l so that it is an eigenstate of the generator, G^q = zq^ or L^ = s ^ , corresponding to the vanishing 
eigenvalue, z$ = or so = 0. Since this invariant density is unique, the multiplicity of this vanishing eigenvalue is 
equal to one in the spectrum of an ergodic system. If A — i_4 is the indicator function of a phase-space domain 
A C Ai, its statistical average defines the probability measure of this domain: (A) = (I a) = n{A). The invariant 
measure fj, corresponds to a statistical ensemble of initial conditions which are distributed in the phase space according 
to the probability density v&g. Therefore, the introduction of an invariant probability measure is equivalent to the 
introduction of a statistical ensemble of initial conditions. The property of ergodicity guarantees the existence and 
uniqueness of this invariant measure. If the boundary conditions do not impose nonequilibrium constraints on the 
system, the invariant probability measure defines the state of thermodynamic equilibrium. 

In 1902, Gibbs introduced the property of mixing which supposes that each time correlation function between two 
observables A and B decay at long times as [5^ 

(A(t)B(0)) ee J A(*'r) B(T) *„(T) dT {A) (B) (15) 

The average (•) is defined with respect to the invariant measure /i of density as in Eq. (|14(1 . If A and B are the 
indicator functions for the corresponding sets A and 23, the condition l|15|) can be rewritten as 

lira n($~*A f)B) = (i(A) fi(B) (16) 

t — >oo 

which expresses the statistical independency between the occurrence of the event A at time t and the event B at the 
initial time t — 0. For this to be the case, the spectrum may not include other discrete frequencies than z = 0, 
otherwise the time evolution would present undamped oscillations. Therefore the mixing property is equivalent to 
supposing that the eigenvalue zq — or sq = is the only one of the discrete spectrum appearing on the real frequency 
axis. The rest of the real frequency axis contains a continuous spectrum. The mixing property is fundamental for 
nonequilibrium statistical mechanics since it guarantees the decay of the time correlation functions. The mixing 
property implies the ergodicity (see Refs. [30T.[56T |). 



E. The Pollicott-Ruelle resonances 



Beside these properties, the unitary group and its spectrum contains little information on the characteristic times 
of the decay or relaxation of the system. In order to obtain the relaxation rates, we have to perform an analytic 
continuation of the resolvent toward the lower half-plane of the complex variable z and can pick up the contributions 
from several complex singularities which can be poles, branch cuts, or else. The poles are called the Pollicott-Ruelle 
resonances Hg, E3- The sum of the contributions from the resonances, the branch cuts, etc... gives us an 
expansion which is valid for positive times t > and which defines the forward semigroup: 

(A)t = f A(T) exp(Zi) po(T) dT ~ £(A|* a ) exp( s ^) (* [po) + ■ • • (17) 

The coefficients of this expansion are given by 

(A|* tt > = J A(T)*y a (T)dr (18) 

(*«Ipo> - J *„(r)*po(r)dr (19) 

in terms of the right- and left-eigenvectors of the Liouvillian operator: 

LV a = s Q * Q i t * Q = s* f a (20) 



The densities ^ a (T) and ^ a (T) are in general mathematical distributions of Gelfand-Schwartz types |23 ■ Accordingly, 
the observable A(T) and the initial probability density po(T) must be sufficiently smooth functions for the integrals 
(|T%|| and ifHfl) to exist. In Eq. (|T7Jl . the dots denote the contributions beside the simple exponentials due to the 
resonances. These contributions may include Jordan-block structures if a resonance has a multiplicity m„ higher than 
unity. In this case, the exponential decay is modified by a power-law dependence on time as t r,la ~ 1 e Sat |29l |. 

On the other hand, the analytic continuation to the upper half-plane gives a similar expansion valid for negative 
times t < 0, which defines the backward semigroup. The time-reversal symmetry implies that a singularity located in 
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the upper half-plane at — z a = —is a corresponds to each complex singularity in the lower half-plane of the variable 
z a = is a and the corresponding eigenstates are related by the time-reversal operator 0. 

The analytic continuation has the effect of breaking the time-reversal symmetry and shows that the semigroups are 
necessarily restricted to one of the two semi-axes of time. 

Several important mathematical questions should be answered in order to obtain such expansions: 

• What is the spectrum of complex singularities of the resolvent? 

• What is the nature of the right- and left-eigenvectors, ^ a and f a , in each term of the expansion? For which 
class of observables A is the right-eigenvector ^ a defined? For which class of initial probability density po is the 
left-eigenvector \P Q defined? 

• Once each term is well defined, does the whole series converge for some classes of observables A and initial 
probability densities po? 

The spectrum of resonances necessarily includes the discrete spectrum of eigenvalues on the axis of real frequencies 
and, in particular, the eigenvalue so = if it exists. Accordingly, the property of ergodicity guarantees the existence 
of a unique invariant state associated with an eigenvalue so = of multiplicity tuq = 1. The property of mixing 
implies that sq = is the only eigenvalue on the axis Res = 0. The measure in Eq. can be expanded in terms of 
the Pollicott-Ruelle resonances, which shows that the mixing property holds if there is no eigenvalue with Re s a = 
other than so = 0. The non-trivial Pollicott-Ruelle resonances of the forward semigroup are then located away from 
the real-frequency axis with Re s a < 0. 

There exist most interesting situations in which the leading Pollicott-Ruelle resonance has a non-vanishing real 
part Re so < 0. This happens for open systems with escape as presented in Sec. IIIII as well as for spatially periodic 
systems as shown in Sec. IIVI In open systems with escape, the leading Pollicott-Ruelle resonance defines the escape 
rate 7 = — So corresponding to the associated eigenvector 

P** = e so ** = e" 7t * (21) 

which defines a conditionally invariant measure p9l |. 

Important results have been obtained for axiom-A systems which is defined as the class of dynamical systems having 
the properties that: 

• Their non-wandering set f2 is hyperbolic; 

• Their periodic orbits are dense in f2. 

The nonwandering set contains all the points for which any neighborhood IA of these points has recurrent nonempty 
intersections U(~)& U at arbitrarily long times t. For these systems, Pollicott and Ruelle have proved that the spectrum 
close to the real axis contains resonances (poles) which are independent of the observable and initial probability density 
within whole classes of smooth enough functions [57ll53 . l59ll60| . Furthermore, it is possible to show that the Pollicott- 
Ruelle resonances of an axiom-A system are given in terms of its unstable periodic orbits. The periodic-orbit theory is 
based on a trace formula which expresses the trace of the Frobenius-Perron operator as a so-called Zeta function which 
is a product over all the unstable periodic orbits of factors involving only the period and the instability eigenvalues 
of each periodic orbit |29t l61| . The Pollicott-Ruelle resonances are thus intrinsic to the system itself if the dynamics 
is hyperbolic as it is the case for axiom-A systems. Therefore, this is a strong theoretical argument showing that 
irreversible properties such as the relaxation or decay rates do not result from approximations and can be obtained 
as the generalized eigenvalues of the Liouvillian dynamics. 

A simple example is provided by the Hamiltonian flow in an inverted harmonic potential. The Hamiltonian of this 
system can be written in the form p9|: 

H = X x y (22) 

where y is the conjugate momentum to x and A is the Lyapunov exponent of the unstable equilibrium point at 
x = y = 0. The rr-coordinate corresponds to the unstable manifold and the y-coordinate to the stable one. The 
solution of Hamilton's equations are <& (x, y) — (e +xt x,e~ xt y) . In the long-time limit t — > +00, exp(— Xt) is a small 
parameter in terms of which we can carried out a Taylor expansion of the statistical averages ijSJ) according to 

(A) t =c- Xt [ dx 1 dypo^x'.y) A (x / ,e~ xt y) = (A\9 lm ) e -^ +m+ ^ (* lm \p ) (23) 

"* l,m=0 
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to obtain the decomposition (|17|) of the forward semigroup [2!j. Therefore, the eigenvalues or Pollicott-Ruelle reso- 
nances are given by the integer multiples of the Lyapunov exponent, si m = —A (I + m + 1) with I, m = 0, 1, 2, 3, ... 
and the eigenstates can be identified as 

^Ux, V) = ^ (-dy)" 1 <%) V) = I V m (-$»)' S(x) (24) 

The eigenstates are given by the derivatives of the Dirac distribution. The support of the right-eigenstates is the 
unstable manifold y — 0, while the left-eigenstates ^>i m have the stable manifold x — for support. 

For non- hyperbolic systems such as intermittent maps or bifurcating equilibrium points, branch cuts appear which 
are associated with power-law decays [62l l63l l64j . The concept of Liouvillian resonance extends to quantum systems 

[HM EH IE3 • 



F. Time- reversal symmetry and its breaking 

The above construction based on the analytic continuation toward complex Liouvillian frequencies breaks the time- 
reversal symmetry. The phenomenon of spontaneous symmetry breaking is well known. Typically, the solutions of an 
equation have a lower s ym metry than the equation itself. This is in particular the case for the time-reversal symmetry 
of Newton's equations |6q . 

At the level of the flow, the time-reversal symmetry of Newton's equations is expressed by 

8o$ f o0 = r ( (25) 

which means that if the phase-space curve 

C = {T t = **(T ) : t £ R} (26) 

is a solution of Newton's equations, then the time-reversed curve 

0(C) = {f*/ = **' o 0(r o ) : (' £ 1} (27) 

starting from the time-reversed initial conditions ©(To) is also a solution of Newton's equations. The further question 
is to know if the solution C of Newton's equations is or is not identical to its time-reversal image ©(C). If we have a 
time-reversal symmetric solution: 

C = ©(C) (28) 

the solution has inherited of the time-reversal symmetry of the equation. However, the solution does not have the 
time-reversal symmetry of the equation if we have a time-reversal non-symmetric solution: 

C ^ ©(C) (29) 

in which case we can speak of the breaking of the time-reversal symmetry by the solution C. 

This reasoning extends to the solutions of Liouville's equation such as the eigenstates ^ a associated with the 
resonances. In general, the equilibrium invariant state 'Jo of a time-reversal symmetric Hamiltonian corresponding to 
the eigenvalue sq = has the time-reversal symmetry: 

Meq(^l) = ^cq(e^l) (30) 

However, time reversal maps the genuine resonances onto the anti-resonances so that the corresponding eigenstates 
are expected to break the symmetry. Indeed, the eigenstates are smooth in the unstable phase-space directions 
but singular in the stable directions as the simple example (122t shows with Eq. I|24|) . Time reversal maps the 
stable directions onto the unstable ones so that the eigenstates of the resonances with Re s a ^ typically break the 
time-reversal symmetry. 

In noncquilibrium steady states, it is very important to make the observation that the invariant probability measure 
itself breaks in general the time- reversal symmetry p9| : 

MneqGA) # A*ncq(e^) (31) 



This is due to the fact that the particles are ingoing the system with a probability distribution which is statistically 
uncorrelated. However, the outgoing probability is highly correlated down to very fine phase-space scales. The state 
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obtained by time reversal would have a highly correlated incoming distribution which is uncorrelated by the internal 
dynamics. This is never the case because the incoming probability distribution is prepared by the environment which in 
general ignore the internal dynamics. Accordingly, the time-reversal symmetry is explicitly broken by nonequilibrium 
boundary conditions. 

In conclusion, the solutions of Newton's or Liouville's equations typically break the time-reversal symmetry notwith- 
standing the fact that the equation itself possesses the symmetry. This phenomenon is known as spontaneous symmetry 
breaking and it here provides an elegant explanation for irreversibility which is therefore not incompatible with the 
symmetry of the basic equation. 

G. From Liouville's equation to master equations 

In this section, we show how Liouville's equation can be applied to closed and open systems in contact with heat 
or particle reservoirs. 

We first consider a closed subsystem in contact with one or several heat baths of Hamiltonian 

H = H s {T s ) + H h {T h ) + U(T s ,r h ) (32) 

where r s denote the positions and momenta of the system and Tb those of the baths. Moreover, we assume that the 
total Hamiltonian takes the form J2J) with interaction potentials depending only on positions. The heat baths play 
the role of thermostats for the subsystem. Liouville's equation l|10(l holds for the probability density pt(T s , Tb) of the 
total system. A reduced description is obtained for the system in terms of the reduced probability density 

f(T s ) = J dT hP (T s ,T h ) (33) 

which obeys the equation 

d t f = {H B ,f}-J2 — - / dr b F as (r s ,r b )p(r s ,r b ) (34) 

a=l ° Pas J 

The last terms represent the average of the forces acting on the particles of the system due to its interaction with the 
baths. An example of such a system is Brownian motion in which case the system reduces to a single heavy particle 
and the bath is composed of the N particles of the surrounding fluid. In the limit of an arbitrarily heavy Brownian 
particle, the mean force on the Brownian particle can be approximated by a force due to the friction of the Brownian 
particle in the fluid and by a diffusive term originating from the fluctuating Langevin force: 

dxidx 2 ■ ■ ■ dx N y F a p ~ pf - (k B T— (35) 

-i m p 

with the notation x a = (r a , p a ). The friction coefficient is given by Kirkwood formula 

C=^/°°( f ( )- f (*)>* ( 36 ) 

where f = 53^Li is the fluctuating force on the Brownian particle [6!|. In this example, Eq. I|34|) becomes the 
Fokker-Planck equation for Brownian motion, which has many applications, in particular, in the nanosciences: 

ft / = - P • £ - F<«*> ■ 9 / + f • ( <-pf) + Ck B Tp- 2 (37) 
m or op op \m J op* 

The previous reasoning can be generalized to the case of a system such as a chain of particles coupled to two heat 
baths at two different temperatures to get 

d (Ck A , , , m d 2 f , d /Cl A , , , m d 2 f 



ft / = {#s, /} + t— • —PR / + CnkBTnjr^T + ^— • — Pl / + Ci^eH-^ (38) 
dp R \m J dpf^ dp L \m J dpi 

where the index R (resp. L) refers to the contact with the right-hand (resp. left-hand) heat bath. The canonical 
equilibrium state is solution if both temperatures are equal Tr = Tl,. 
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Albeit similar, the situation is more complicated for an open subsystem in contact with one or several particle 
reservoirs, which here play the role of chemiostats as well as of thermostats. (We can possibly add extra heat baths 
or thermostats which exchange heat but no particles with the subsystem.) We suppose that the subsystem and the 
reservoirs compose an isolated total system of volume V containing J\f identical particles of mass m. The subsystem 
itself is one part of the total system of volume V . This volume may be delimited by an external potential which 
separates the particles between the subsystem and the reservoirs. We consider particles with binary interaction for 
simplicity. For the total system, Liouville's equation becomes 

ttV m dr a dp a J \dp a dp b J 

where Fi° xt ' ) is the external force on the particle No. a and F a fc is the binary-interaction force on the particle No. a 
caused by the particle No. b. The particles are identical so that the probability density p(x\, —,xj^) should be totally 
symmetry under the M\ permutations of the indices. We introduce the distribution functions 

M\ [ t 
f N (xi,x 2 ,—,XN) = — r ^ry / dx N+1 ... I dx^f p(xi,x 2 , -,xj^) (40) 



(Af-N)\ 



v-v Jv-v 



The probabilities P{N) that the system in the volume V contains N particles are thus given by the integrals of 
the functions (|40|) over the volume V N divided by iV!. They are normalized according to X)iV=o = 1 as a 

consequence of the symmetry of the probability density and Iy(x) + Iv-v( x ) = 1- 

A hierarchy of equations can be derived for the distribution functions (|40|) which are similar but different from the 
BBGKY equations 0: 

-t- 

a—l 



a / dx N+l F a . N+1 /jv+1 - ®N (41) 



V-V 



where the fluxes of particles 

$ N (xi,...,x N ) = ( . r _' v / dx N+1 ... dx H J2 ^-7& ( 42 ) 



(M-N)\J V _ V " +L -J V _ V J \^ +I m dv a 

take into account the transitions between configurations with different numbers N of particles in the volume V. The 
terms with the mean forces are similar to the terms encountered for Brownian motion and are due to the Langevin 
fluctuating force of the environment on the particles in V. The flux term is specific to open systems and should 
describe the transitions N ^ N + 1 in the number of particles in the volume V. A hierarchy of differential equations 
for the probabilities P(N) is naturally associated with Eqs. l(lT ]l -l(12 )l , In Eqs. il4T]l - ill2|) . the flux term includes the 
fluxes between the system and the different reservoirs. If the reservoirs are very large, their discharge is very slow and 
a quasi-stationary nonequilibrium state will establish itself, which is specified by the temperatures and the chemical 
potentials of the reservoirs. Contrary to the case of the BBGKY equations [7(|, we should here not truncate the 
hierarchy because the number N of particles in the volume V is a fluctuating variable that is ruled by the complete 
set of equations. In order to close the set of equations, we should instead express the fluxes as well as the external 
forces in terms of the functions /jv themselves by using kinetic assumptions about the energy and particle exchanges 
with the environment. For the external forces, the treatment is similar as for Brownian motion and introduces of the 
friction and Langevin forces (related by the fluctuation-dissipation theorem). For the fluxes, we are led to kinetic 
assumptions as done for the Poisson process (see below). 

The present framework can be extended to chemical reactions in systems with several species of particles. The 
system of volume V can be conceived as a nanoreactor or as the catalytic site of a protein complex. In particular, 
equations similar to Eqs. I|41l) - (|42l) can be used to model a nanomotor fuelled by ATP. In this case, the volume V 
represents the spatial domain occupied by the protein including the binding site of ATP which can contain for instance 
zero or one fuel molecule. 

By using a Markovian approximation, we are led to master equations such as the Fokker-Planck equation, the Pauli 
master equation [7l|], or the chemical master equation by Nicolis and coworkers ff%. I73L (see Sec. 0. A master 
equation is a closed rate equation for the probabilities to find the system in some coarse-grained states lo which 
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are defined by integrating the probability density Pt(T) over the corresponding phase-space cells C u . The symbol 
u> denotes for instance a state with given numbers of molecules for the c different species present in the volume V: 
uj = (Ni,N2, ...,N C ). A finer description would be obtained by specifying also the phases of these particles in the 
system V. The Fokker- Planck equation can be obtained in the limit of continuous state variables. If the master 
equation provides a faithful representation of the time evolution, the lowest eigenvalues of the master equation should 
correspond to the Pollicott-Ruelle resonances of the underlying deterministic dynamics. 

In conclusion, equations H4i p -Q42 p can be used to model many nonequilibrium systems in nanosciences, especially, 
in nanohydrodynamics, chemical and biochemical reactions in nanosystems such as biological motors. In this way, 
master equations as Eqs. (|41() - (I42|) can naturally be derived from the underlying Hamiltonian microscopic dynamics. 

H. The concept of entropy 

The concept of entropy is clearly extra mechanical. It has been introduced at the beginning of the XlXth century 
by the pioneering work of Carnot and Clausius. In thermodynamics, entropy is used to express the second law of 
thermodynamics: The changes of the entropy in a system are due to the exchanges do"!? with its environment and to 
a possible internal production d[S which vanishes at equilibrium and is positive out of equilibrium 

dS = d c S + diS with diS > (43) 

The second law allows us to distinguish between equilibrium and nonequilibrium systems. The pressure, the temper- 
ature, and the chemical potentials are uniform at equilibrium. Each bath or reservoir in contact with a nanosystem 
is in general much larger than the system itself and may be assumed in equilibrium and thus characterized by a 
temperature and as many chemical potentials as there are species of particles (including the electrons in electronic 
transport phenomena). The nanosystem between the reservoirs is in a nonequilibrium state if the reservoirs have 
different temperatures or chemical potentials. For instance, the temperatures of the baths and reservoirs are fixed in 
Eq. Ij38(l by the terms of coupling to the heat baths. Similarly, the fluxes (|42|l depend on the chemical potentials of 
the particle reservoirs and fix them in Eqs. I|41|) . 

Since Carnot and Clausius, an idea of partition is associated with the concept of entropy. Indeed, the original aim 
of thermodynamics is to answer the question of extracting work by manipulating a gas in a steam engine. A steam 
engine is composed not only of the gas but also of a piston which is a larger degree of freedom than those of the 
gas particles and by which the external manipulation is performed. Accordingly, entropy concerns the properties of 
system when it is manipulated by larger and external degrees of freedom. This reasoning suggests that coarse graining 
is naturally associated with the concept of entropy which is the property of a system with respect to certain types of 
external manipulations. The manipulations we are referring to include the active preparation of initial conditions, 
but exclude mere observations that do not interact with the particles. From this viewpoint, the partitioning or coarse 
graining we refer to is not subjective. For two centuries of study of entropy and thermodynamics, we have learned that 
systems present general properties which are essential to know for their external manipulation and which go beyond 
the simple motion of the particles from given initial conditions. The progress of this last decade has emphasized this 
trend. 

The status of entropy with respect to the underlying Newtonian mechanics was clarified at the end of the XlXth 
century and the beginning of the XXth century. If we associate an entropy to a microstate T we should not be 
surprised that the fluctuations spoil a hypothetical monotonic increase of the entropy and that apparent violations 
of the second law would manifest themselves. This has already been pointed out by Maxwell when he invented his 
famous demon. Boltzmann made a specific proposal for a microscopic definition of entropy in terms of his famous 
ii-function in dilute gases. Finally, Gibbs introduced his coarse-grained entropy and he showed that we should expect 
an increase of this quantity from its initial value in the case of mixing systems. Both Boltzmann and Gibbs definitions 
of entropy refers to a statistical description and lead to the interpretation of entropy as a measure of the disorder of 
the statistical state of the system. 

Gibbs' formulation explicitly refers to the probability distribution p(T) at the current time t |55j| . This probability 
distribution corresponds to an equivalent statistical ensemble of phase-space points. The entropy characterizes the 
disorder in this statistical ensemble. Since the different possible microstates T form a continuum, a partition of the 
phase space is required in order to proceed with the definition of discrete coarse-grained states and the counting 
of their complexions. The phase space of the system is partitioned into disjoint cells C u forming the partition 
V = {Ci, C2, Cm}- These cells can be considered as the sets of microstates of the total system corresponding to the 
states to G {1, 2, N} of some measuring device observing and possibly manipulating the system for the preparation 
of some initial condition. The coarse-grained states corresponding to the events reC u are now discrete and can be 
counted. We can see in the statistical ensemble how many copies of the system belong to a given cell C^. For this 
purpose, let us observe the M first copies and count the numbers A/L of copies in the state to. The observation of the 
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AT first copies generates a sequence of coarse-grained states U!±u>2---U)j\f an d AT — ^ w A/L- The frequency of occurrence 
of the state oj gives the corresponding probability 

Jim ^=P( W )= / dTp(T) (44) 



The copies being statistically independent, the number of possible sequences of successive states is given by 

TV! 



IL-A/L 



exp 



-M^P{uj)\nP{uj) 



(45) 



where Stirling's formula A/1 ~ (Af/e)^ was used. Typically, this number grows exponentially at a rate given in terms 
of the entropy 

S= -jfeB^P(w)ln?(w) (46) 

where Boltzmann's constant gives the proper physical units to the entropy. This entropy provides a measure of the 
disorder in the statistical ensemble described by the probability distribution {P(w)}. Indeed, the entropy vanishes if 
a single state u> is present in the ensemble and the entropy reaches its maximum possible value if the probabilities 
P(w) = are uniformly distributed over all the states u> as for a microcanonical equilibrium ensemble on an energy 
shell. In this latter case, we recover Boltzmann's formula S = fce lnf2 from Eq. (|46[) . 

The definition 14tj|) is consistent with the thermodynamic value of the entropy at equilibrium if the phase-space 
cells are identified as the quantum states. In the classical-quantum correspondence, the quantum states correspond to 
phase-space cells of volume AT = (2irh) 3N . The probabilities are thus given by P{ui) — p(T) AT, so that the entropy 
becomes 



S~fc B m-!--fcB / dTp(T)\np(T)+0(AT) (47) 



For a dilute gas of identical particles with a Maxwell distribution of velocities, this entropy gives the Sackur- Tetrode 
formula since A4 denotes the phase space of non-identical phases which is a fraction 1/N\ of M. 6N . Without quantum 
mechanics which fixes the smallest possible phase space volume AT, the entropy could become arbitrarily large in 
the limit AT — > 0. This is not surprising because the probability density p(T) means that the random variables T 
are continuous and are distributed over a continuum of possible values, so that this distribution has randomness on 
arbitrarily small scales contrary to the case of a discrete random variable. The second term in Eq. I|47[l is often called 
the differential entropy in the mathematical literature or Gibbs' fine-grained entropy. However, it does not provide a 
complete measure of disorder without the first term. 

Different kinds of coarse graining can be envisaged. If we describe the system in terms of macrovariables such as 
the energy, the states u> correspond to phase-space cells such that E < H(T) < E + AE where H is the Hamiltonian 
function. In a dilute gas we can consider the numbers of molecules in cells of the position and momentum space (the 
so-called /x-space instead of the T-space). Fixing these numbers of molecules also amounts to define domains C w in 
the phase space. We can also expand the entropy 147fl in terms of the distribution functions of one, two, three,... 
particles [23 and truncate this so-called Nettleton-Green expansion to get a coarse-grained entropy. These different 
definitions can be summarized with Eq. (|46|) . 

The expression (|47|l is not useful for nonequilibrium systems because it remains constant in time if the terms of 
order Ar beyond the two explicitly given are neglected. In contrast, the entropy (|46|l evolves in time in a nontrivial 
way. Indeed, Gibbs' mixing property implies that the probabilities Pt(w) converge to their equilibrium values 
P eq (a>) as t — » oo, which allows us to understand why the coarse-grained entropy l|46|) can increase from its initial 
value up to its asymptotic equilibrium value. Since the equilibrium distribution is broader than the initial one, we 
should expect that S eq > Sq. 

Recent work has shown that, indeed, the entropy increases. A monotonic increase is even possible to obtain if 
the partition of the phase space is chosen with respect to the dynamics |76|. The way the entropy increases can be 
calculated thanks to the expansion (|17|) , which shows that the rate of increase of the entropy is directly determined by 
the Pollicott-Ruelle resonances which are intrinsic to the system. We should thus expect that the entropy production 
rate calculated in this way is a property of the system which is independent to a large extend of the way the partition 
is chosen. This expectation is confirmed by the detailed calculation of the entropy production in specific systems (see 
below) . 
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I. Dynamical randomness and entropies per unit time 

If the standard thermodynamic entropy is a measure of the disorder in the probability distribution describing the 
system at the current time, a further concept has been introduced in order to characterize the temporal disorder 
of a process evolving in time. The concept of entro py p er unit time has been introduced in the context of random 
processes by Shannon [TtJ and, later, by Kolmogorov and Sinai [7jJ in dynamical systems theory. The phase space 
of the system is here again partitioned into disjoint cells C w forming the partition V = {Ci,C2, ...,Cjv}- The symbolic 
sequence u) = LUQUJi...uj n -i defines a path or history which is a set of trajectories visiting the cells C ujQ C Ul ...C u)n _ 1 at 
the successive times t k = kr (k = 0, 1, n — 1): $ tfc T 6 C Uk . The system is observed in a stationary state described 
by the invariant probability measure \i. 

The multiple-time probability to observe the system in the successive coarse-grained states u>oUj\...uj n ~i at regular 
time intervals r is given by 

vt(u>) = M(wowi...«n~i) = n (c Uo n *~ T c Wl n ... n *- (n - 1)T c £l) „_ 1 ) (48) 

where fi is an invariant measure of the time evolution and is assumed to be the stationary probability of the 
nonequilibrium steady state. The standard entropy per unit time of the partition V is defined as the mean decay rate 
of the multiple-time probability (|4*S1) as [2^, 

h(V) = lim *S^jU(cj) ln/ifw) = lim n(u)oU)\...u) n —\) ln/x(u>oWi...w ri _i) (49) 

n — >oa jit ^ — ' n — >oo JIT — ' 

The entropy per unit time characterizes the dynamical randomness of the time evolution observed with the measur- 
ing device. The entropy per unit time can be defined for stochastic processes as well as for deterministic dynamical 
systems. For stochastic processes such as the Ornstein-Uhlenbeck process, the entropy per unit time depends in gen- 
eral on the size e of the cells used to make the partition as well as on the sampling time r. Accordingly, a concept of 
(e, r)-entropy per unit time has been introduced which characterizes the randomness as a function of the parameters 
e and r pllsq. 

For stochastic processes with discrete state variables as well as for deterministic dynamical systems, the entropy 
per unit time presents a supremum. The supremum of the dynamical entropy (|49|) over all the possible partitions V 
defines the Kolmogorov-Sinai (KS) entropy per unit time 

h KS - Sup v h(V) (50) 

which is thus a quantity intrinsic to the system [2^, E(| [Tgl |7j| . 

In isolated dynamical systems, the KS entropy is given by the sum of positive Lyapunov exponents according to 
Pesin's theorem |22,E]]. We shall present a proof of this result in the next section. This fundamental result shows that 
dynamical instability implies dynamical randomness. The concept of entropy per unit time appears to be fundamental 
because it is the one which characterizes randomness. The name "chaos" explicitly refers to a property of randomness 
so that it is natural to define the chaotic systems as deterministic systems with a positive entropy per unit time |29| . 
We notice that dynamical instability is not enough for dynamical randomness as the example 112 2 1 shows. Moreover, 
the entropy per unit time can be defined for systems without Lyapunov exponent, allowing to extend the concept of 
dynamical chaos. 

The dynamical entropy does not vanish at equilibrium in chaotic systems contrary to the entropy production and 
no proportionality exists between these quantities. The entropy per unit time is nevertheless the temporal analogue of 
the standard thermodynamic entropy. Typical bulk equilibrium phases are spatially extended and present a positive 
entropy per unit volume s = S/V. This quantity can be defined by Eq. lj4*9")l if u n denotes the local state of the 
particles in cells separated by the distance r. For instance, in a spin chain, u n may represent the state of a spin. 
The entropy per unit volume is known to characterize the spatial disorder of the equilibrium phase: the successive 
spins point in random orientations along the chain. The entropy per unit time is the analogue with space replaced by 
time. A process of time evolution is recorded and displayed along the time axis as the successive pictures of movies. 
At successive times, the system is in different states oj n which form a random sequence of events. The entropy per 
unit time characterizes the temporal disorder of the movies. For a coin-tossing process, head and tail both have 
probabilities equal to one half. In this case, the multiple-time probability l|48l) decays as 1/2" so that the entropy per 
unit time is equal to h — In 2. For a game of dices, it is equal to h = In 6. 

In nonequilibrium processes, we have already pointed out that the invariant measure may break the time-reversal 
symmetry. It is therefore interesting to introduce a concept of time-reversal entro py p er unit time in order to charac- 
terize the dynamical randomness of the time-reversed trajectories of the process |45j. We consider the time-reversed 
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path (or time-reversed history): w R = ui n -x...u>iUjQ. We are interested by the probability /i(w R ) = fJ,(u) n -i...uiiU>o) of 
occurrence of the time-reversed path in the process taking place in the nonequilibrium stationary process. We define 
the time-reversed entropy per unit time as |45j 

h K {V) = lim — — In /i(o; R ) = lim — — /ifcJo^i—kVi-i) ln^i(oj„_i...wiwo) (51) 

UJ UJQUJ±...UJ n — i 

We emphasize that the average is taken with respect to the probability of the forward path. We can say that the 
time- reversed entropy per unit time characterizes the dynamical randomness of the time-reversed paths in the forward 
process of the nonequilibrium steady state. We shall see in Sec. IVII that both dynamical entropies can be combined 
to form the entropy production of nonequilibrium processes. 



III. THE ESCAPE-RATE FORMALISM 



The purpose of the escape-rate theory of transport is to relate the transport coefficients to the characteristic 
quantities of motion which are the Lyapunov exponents, the Kolmogorov-Sinai entropy, and the fractal dimensions 
[24L I25L l2fil 1271 l28l l29| . Thanks to the escape-rate formalism, relationships can be established in full respect for the 
Hamiltonian character of the microscopic dynamics and Liouville's theorem in contrast with other approaches. The 
escape-rate formalism uses the result that each transport coefficient can be obtained from the random walk of its 
associated Helfand moment which is the centroid of the conserved quantity corresponding to the transport property 
of interest. We can set up a first-passage problem for the diffusive motion of the centroid. Trajectories of the whole 
system of particles are supposed to escape from a certain domain of phase space. This domain is defined by imposing 
threshold value for the centroid or Helfand moment. The number of trajectories which are still inside this so-defined 
phase-space domain decreases with time when a trajectory reaches the boundary of this domain. An equivalent way 
of presenting the problem is to consider absorbing boundary conditions as discussed here above after Eq. Ijl2|l . The 
decay is typically exponential, which defines an escape rate 7. The escape rate is proportional to the transport 
coefficient. On the other hand, the escape rate is given in terms of the Lyapunov exponents, the Kolmogorov-Sinai 
entropy, and the fractal dimensions. This results into chaos-transport relationships as explained in this section. 



A. The transport coefficients and their Helfand moment 



It is known since the sixties that the coefficients of transport properties such as diffusion, viscosity, or heat conduc- 
tivity can be obtained from the fluctuation properties of the Helfand moments or the corresponding microscopic 
currents 

j{a) _ dG^/dt jUil Hi- A transport coefficient is given as the integral of the time autocorrelation 
function of the associated microscopic current by the Green-Kubo formula [12, H3 or, equivalently, as the rate of 
linear growth of the variance of the Helfand moment [84| 

r°° 1 
« = / (4 a) 4 a) ) dt = lim ± ((<#"> - G^ f) (52) 

The Helfand moments associated with the different transport properties are given in Table I. Each one of them 
represents the centroid of the conserved quantity which is locally transported. For the diffusion of a Brownian 
particle, the Helfand moment is simply the position of the particle. For viscosity, it is the center of momenta of all 
the particles in the fluid. And so forth. 



TABLE I. Helfand's moments of different transport properties. 



transport property 


moment 






self-diffusion 


G <P) = 


Xi 




shear viscosity 


gm = 


1 

VVk B T 


Z^i=l x i Piy 


bulk viscosity (ip = C + f 7 ?) 


G w = 


1 

VVk B T 


/ Vix 


heat conductivity 


<?(«) = 


1 

VVk B T'^ 




electric conductivity 


= 


1 

VVk B T 


l &i 
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The Einstein-like formula in Eq. (|52() shows that the Helfand moments have a diffusive motion. A first passage 
problem can be set up by imposing absorbing boundary conditions in the space of variation of the Helfand moment 
[26|. These absorbing boundary conditions select all the trajectories of the whole system for which the Helfand 
moment never reaches the absorbing boundaries: 

-f < G[ a) < + | (53) 

However, most of the trajectories reach the absorbing boundaries and escape out of the domain delimited by these 
boundaries. Accordingly, the trajectories forever trapped inside the absorbing boundaries form a set of zero probability 
and composed of unstable trajectories. This set is called the repeller and is characterized by an escape rate which can 
be evaluated by using a diffusive equation for the motion of the Helfand moment g — G\ 

with the corresponding absorbing boundary conditions p(g = ±x/2, t) — 0. The solution of this equation is given by 

V"^ 1 \ ■ ( J n 9 3 n \ ( j 7r \ 

P[9,t) = 2_, a i ex P(-7j*) sin ^— + —j with 7j = a (--) 

The escape rate is the slowest decay rate which is thus related to the transport coefficient a according to 

\ 2 

7T 



(55) 



7 ~ 7! — a y— j for \ — > 00 (56) 

In the case of the Brownian motion in a fluid inside a container, the Helfand moment is the position of the Brownian 
particle. The particle is supposed to escape if its position reaches for instance a sphere A of diameter L in the physical 
space as illustrated in Fig. This condition corresponds to a certain domain in the phase space of the whole system 
composed of the Brownian particle and the particles of the surrounding fluid. 

In the case of viscosity, the Helfand moment is the center of momenta of all the particles of the fluid. This Helfand 
moment or centroid performs a random walk as illustrated in Fig. [SJs. Here again, a phase-space domain corresponds 
to the condition that this centroid is found in the domain A of width L in the physical space. 




FIG. 2: Schematic illustration of the application of the escape-rate theory to (a) the diffusion of a Brownian particle escaping 
out of a sphere A of diameter L in a fluid of volume V and (b) the viscosity in a fluid of volume V in which the Helfand moment 
Gt escapes out of a domain A of width L. 



B. Escape and dynamical randomness 



The escape rate turns out to be related to the characteristic quantities of the underlying dynamics such as the 
Lyapunov exponents, the Kolmogorov-Sinai entropy per unit time, and the fractal dimensions. These relationships 
can be obtained even for one-dimensional maps such as the one depicted in Fig. |3K- The time for the escape of 
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trajectories depends on their initial condition as shown in Fig. [^Jd. This is a highly complicated function with 
vertical asymptotes on a Cantor set. For these initial conditions, the escape time is infinite so that the trajectory 
remains trapped in the unit interval. The Cantor set is of zero Lebesgue measure but contains uncountably many 
trajectories. In this simple system, the partition into the two intervals [0, 0.5[ and [0.5, 1] to which the symbols and 
1 are assigned allows us to associate a symbolic sequence u)oWiU>2...u} n ... (also called a path or a history) with each 
trajectory. Furthermore, this correspondence is one-to-one for the trapped trajectories of the Cantor set, in which 
case we speak about a generating partition. Along a given trajectory, an infinitesimal interval will be expanded by 
the so-called stretching factor A(w) = A(cJoka,CL>2"-k>n-i)j which is given by the product of the slopes Ao = +s and 
Ai = — s for the map of Fig. A family of invariant probability measures can be defined as 

|A(w)h' 3 

« Ws PHP (57) 

in the limit n — > oo. These probability measures are normalized to unity. The different values of the parameter /3 
are not of equal interest for the Liouvillian dynamics. Indeed, an ensemble of initial conditions uniformly distributed 
in a small interval [x,x + Ax] with a probability density 1/A.x will broaden under the effect of the dynamics. After 
n iterates, the probability density would drop to (|A(w)|Aa;) _1 , which shows that (3 = 1 is the value used by the 
Liouvillian dynamics. The escape rate can be obtained by noting that the length of the intervals which have not 
escaped till the n th iterate is given by ^ w |A(w)| _1 so that the escape rate is given by 

7= Urn -— laV^r (58) 

n-r^oo TIT ^ |A(w)| 

Here again, the value /3 = 1 is selected in agreement with the fact that the escape rate is the leading Liouvillian 
eigenvalue. 





0.2 0.4 0.6 0.8 1 



FIG. 3: (a) First return plot of the one-dimensional map x n +i = s ^~ — \x n — 1 1) with a slope s larger than two. (b) Time 
taken by a trajectory to escape out of the unit interval under the dynamics of the map (a) versus the initial condition x of the 
trajectory. We observe that this escape time varies in an extremely complex way and that it becomes infinite for each initial 
condition taken on the Cantor set of trapped trajectories. For this map, the escape rate 11581 is given by 7 = Ins — In 2, the 
Lyapunov exponent 1591 by A(/3) = Ins, the Ruelle topological pressure by P{(3) = In 2 - In s, the entropy per unit time 
l(j2H by h(/3) — In 2, and the generalized fractal dimension (16411 by d q = (ln2)/(lns), as can be checked using the corresponding 
definitions presented in the text. 

Nevertheless, the other values may also be of interest. In particular, we notice that the value = leads to a 
measure which gives the same probability weight on each trajectory independently of its instability. Therefore, the 
value [3 = is interesting for counting the trajectories and characterizes the dynamics from a topological point of 
view. 

The average Lyapunov exponent with respect to the invariant measure (|57f) is defined by 

\(J3)= lim — yW«)ln|A(u;)| (59) 

n— >oo jit ' * 
it) 
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where r = 1 in the special case of a map. The mean positive Lyapunov exponent of the classical dynamics is given 
by the value at (3 = 1: A = A(l). We can here introduce the so-called Ruelle topological pressure |§5j 

P{fi)= lim — InV 1 (60) 

V ' ' nr^oo TIT ^ \A((jj)\P 

which contains both the escape rate and the mean Lyapunov exponent as 

7 = -P(l) A = -P'(l) (61) 

Now, if we calculate the entropy per unit time (|49|l of the invariant measure l|57|). we obtain from the preceding 
definitions that [85| 

h((3) = (3 \{fi) + P((3) (62) 

When restricting this relation to the value /3 = 1 and supposing that the partition is generating the entropy per unit 
time becomes the Kolmogorov-Sinai entropy, h(l) — hj^g, and Eq. i|62[l becomes the fundamental escape-rate formula 



7 = A - h KS (63) 

Properties such as the topological pressure, the KS entropy, and the Lyapunov exponents arc known as large- 
deviation dynamical properties because they concern probabilities or phase-space volumes with exponential behavior 
in time and which are thus rapidly suppressed in time. These large-deviation properties are at the basis of the 
thermodynamic formalism [8q|. 

Generalized fractal dimensions d q of parameter q can also be defined for the Cantor set with the natural probability 
measure fi = fi\ by the condition 

- 1 for n -> oo (64) 

where £(u>) ~ |A(a;)| _1 denotes the size of the interval associated with the trajectories of symbolic sequence u>. With 
the aforementioned definitions, the generalized fractal dimension d q is given as the root of the following equation |29| : 



P[q+(1- q)d q ] = - ql (65) 

The Hausdorff dimension d a = rffj is simply the root of the pressure function, P(g?h) = 0, while the information 
dimension is given by d\ = d\ = Iiks/X 1871 ]. The escape-rate formula can be rewritten in terms of the information 
dimension as 7 = A(l — d\). Further material can be found in Refs. [2^.l30| . 

The preceding results extend to Hamiltonian systems with two degrees of freedom and a single positive Lyapunov 
exponent. For these systems, the previous reasoning holds if we consider the x-axis of the one-dimensional map of Fig. 
13 as the stable or unstable direction. For the forward time evolution, the conditionally invariant probability measure 
(|21|l is smooth in the unstable direction but fractal in the stable direction. The aforementioned fractal dimensions 
thus characterize its structure in the stable direction. By time-reversal symmetry, a similar structure appears in the 
unstable direction for the backward time evolution and an invariant measure can even be defined for the set of forever 
trapped trajectories which is a fractal of dimension D q = 2d q + 1 in the three-dimensional energy shell |88[ . In this 
regard, d q is a partial dimension while D q is the total one. 

In systems with a higher-dimensional phase space and several positive Lyapunov exponents, A(a>) represents the 
expansion in all the unstable directions so that A should be replaced by the sum of positive Lyapunov exponents: 

7= J2 X i~ h *s= J2 Ml-*) (66) 

Ai>0 Ai>0 

where di denotes a partial information dimension associated with each unstable direction |89| . 

The invariant measure or the conditionally invariant measure are here defined on a fractal set of unstable trajectories 
(or their stable manifolds) called the fractal repeller. The escape rate is the leading Pollicott-Ruelle resonance so = —7 
for the dynamics on this fractal repeller. 

If the system is progressively isolated by switching off the escape of trajectories, the escape rate vanishes, the partial 
dimensions take the unit value, and we obtain the famous Pesin identity \8l\ 



h-KS = ^ Ai 

A;>0 



(67) 
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Consequently, we can conclude that the dynamical instability characterized by the Lyapunov exponents is directly 
responsible for the dynamical randomness of the time evolution and the positive KS entropy. This result shows that 
the KS entropy is a concept which is here equivalent to the property characterized by the Lyapunov exponent with 
the advantage that it can be extended to systems in which the Lyapunov exponent are not defined or irrelevant to 
the fundamental property of randomness. The escape-rate formula l|66|) generalizes Pesin's identity to open systems 
with escape. 



C. The chaos-transport formula 

If we combine the escape-rate formula (|66l) with the proportionality 1)56(1 of the escape rate to the transport coef- 
ficient, we obtain the following large-deviation relationships between the transport coefficients and the characteristic 
quantities of chaos [2t| 



= lim I — 



A;>0 



= lim I — 



Ai>0 



Ai(l-di) 



(68) 



In the limit \ ~ > 00 > the partial information codimensions can be replaced by the Hausdorff codimensions in hyperbolic 
systems. This formula has already been applied to diffusion in periodic and random Lorentz gases l90j|. reaction- 
diffusion [sU , as well as viscosity [53, E3 ■ 

Detailed results have been obtained for diffusion in the open two-dimensional periodic Lorentz gas (see Fig. 
|25|. In this system, the particles have a deterministic diffusive motion induced by the elastic collisions on immobile 
scatterers until the particles escape upon reaching absorbing boundaries in the form of a hexagon, a circle, or two 
parallel lines separated by a large distance L. The absorbing boundary conditions select a fractal repeller of trapped 
trajectories which can be numerically evidenced by plotting the time to escape as a function of initial conditions (see 
Fig. EJd). In this two-degree-of- freedom system, there is only one unstable direction and, thus, one positive Lyapunov 
exponent and associated codimension. Accordingly, Eq. I|68|) shows that the diffusion coefficient is given in terms of 
the positive Lyapunov exponent and the fractal dimension of the underlying set of trapped trajectories |24i l25j| : 



V = lim 

L — >oo 



(A - kfss) L = lim 

L — t-oo 



A(l - d) 



(69) 



where d is either the information or the Hausdorff partial dimension associated with the unstable direction. 



^ 





FIG. 4: Open Lorentz gas: (a) configuration of the system with a typical trajectory; (b) time taken by the particle to escape 
versus the initial angle 6 — 0.75-7T — uttW~ 10 of velocity of the particle starting from the central disk. The escape time becomes 
infinite on each stable manifold of a trapped trajectory. 
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IV. CONSTRUCTION OF THE HYDRODYNAMIC MODES 
A. Diffusion in spatially periodic systems 

We now consider dynamical systems which are spatially extended and which can sustain a transport process of 
diffusion. We moreover assume that the system is invariant under a discrete Abelian subgroup of spatial translations 
{a}. The invariance of the Liouvillian time evolution under this subgroup means that the Perron- Frobenius operator 
P = exp(Li) commutes with the translation operators T a , whereupon these operators admit common eigenstates: 

P** k = exp(s k i)* k . . 

T a * k = exp(ik • a)* k 1 ' 

where k is called the wavenumber or Bloch parameter (23 ■ The Pollicott-Ruelle resonances s k are now functions of 
the wavenumber. The leading Pollicott-Ruelle resonance which vanishes with the wavenumber defines the dispersion 
relation of diffusion: 

.s k = -Vk 2 + 0(k 4 ) (71) 
The diffusion coefficient is given by the Green-Kubo formula: 



V= / (v w (0)v x {t)) dt (72) 
Jo 

where v x is the velocity of the diffusing particle. The associated eigenstate is the hydrodynamic mode of diffusion \& k . 

B. Fractality of the hydrodynamic modes of diffusion 

In strongly chaotic systems, the diffusive eigenstate vp^. is a Gelf and- Schwartz distribution which cannot be depicted 
except by its cumulative function 



F k (9) = [ * k (r»^' 

Jo 



(73) 



defined by integrating over a curve xg in the phase space (with < 6 < 2ir). 

We notice that the eigenstate ^k of the forward semigroup can be obtained by applying the time evolution operator 
over an arbitrary long time from an initial function which is spatially periodic of wavenumber k so that the cumulative 
function l(75|) is equivalently defined by [92J 

/if d6' exp fik • (17 — To VI 

F k (0) = lim ^ ^ K — (74) 

^°°/c rd0'exp[ik-(r t -r o V] 

This function is normalized to take the unit value at 6 = 2it. For vanishing wavenumber, the cumulative function is 
equal to Fk(6) — 9/(2w), which is the cumulative function of the microcanonical uniform distribution in phase space. 
For nonvanishing wavenumbers, the cumulative function becomes complex. The cumulative functions of the diffusive 
modes are depicted in Fig. 0for the multibaker model of diffusion and in Fig. Elfor the hard-disk Lorentz gas. These 
cumulative functions form fractal curves in the complex plane (ReFk, Imi 7 ^). The Hausdorff dimension Dr of these 
fractal curves can be calculated as follows. If we write Eq. (|74|l in terms of the symbolic dynamics and if we notice 
that the denominator behaves as exp(sk^), we get: 

F k (0)= lim V — e lk - (r " T - ro) " e- SknT = lim VAf k (w) (75) 

n— >oo ^ — ' A(W) ^ — ' 

which constitutes an approximation of the cumulative function as a polygonal curve formed by a sequence of complex 
vectors. The Hausdorff dimension of this curve is given by the condition 

\AF k (u))\ Dl1 - 1 for n^oo (76) 
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This condition can be rewritten in terms of the topological pressure (|60ll to obtain the formula: 



P{D H ) = D K Re s k 



(77) 



for the Hausdorff dimension [93] • 

There is no escape of particles from the system so that its escape rate vanishes and 7 = — P(l) = 0. The Hausdorff 
dimension can thus be expanded in powers of the wavenumber as Dn(k) = 1 + (2?/A)k 2 + C(k 4 ) so that the diffusion 
coefficient is obtained from the Hausdorff dimension and the Lyapunov exponent by the formula 



V = A hm (78) 

This formula has been verified for different dynamical systems sustaining deterministic diffusion [§3 • 

We notice that the large- deviation formula l|78|l has a form very similar to the chaos-transport relationship I|fci9|) 
of the escape-rate formalism. Indeed, if we consider that the two successive ascending and descending nodes of the 
mode of wavenumber k are located at the absorbing boundary separated by a distance L, the wavenumber is equal to 
k = ir/L and the dispersion relation of diffusion gives the escape rate Re Sk — —T>(tt/L) 2 ~ —7. On the other hand, 
we find the Lyapunov exponent as well as a fractal dimension in the right-hand side of both Eqs. (|fj9l and J7SJ. This 
shows the close connection with the escape-rate formalism. 




FIG. 5: The diffusive modes of the multibaker map represented by their cumulative function depicted in the complex plane 
(Re Fk, ImFt) versus the wavenumber k. The multibaker map is defined by cj>(l,x,y) = (l — 1,2s, ^) for < x < 1/2 and 
4>{l,x,y) = (I + 1, 2x - 1, ^±i) for 1 > x > 1/2 with I € Z [H,[<||- The leading Pollicott-Ruelle resonance is s k = lncosfc. The 
topological pressure is here given by P(/3) = (1 — /3) In 2 because the map is uniformly expanding by a factor 2. According to 
Eq. jnj, the Hausdorff dimension is D H = (In 2)/[ln(2 cos A:)] [o3 |. 



C. Nonequilibrium steady state 

The nonequilibrium steady state corresponding to a gradient of concentration maintained between two reservoirs 
of particles at different chemical potentials can be obtained from the diffusive modes at small wavenumbers according 
to 



-% g 



dk 



k=0 



(79) 



where g is the gradient of concentration 93]. This leads to the nonequilibrium steady state described by the density: 



* s (r) = g 



r(r)+ / v(*T)di 





(80) 
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FIG. 6: The diffusive modes of the periodic hard-disk Lorentz gas represented by their cumulative function depicted in the 
complex plane (Re F^, ImF^) versus the wavenumber k which points out of the page [9^| . 



which is singular. These densities admit cumulative functions also known as generalized Takagi functions 29, 3(J,l93j. 
These functions are typically self-similar. An example is depicted in Fig. 0for the hard-disk periodic Lorentz gas J9jj|. 
These cumulative functions are smooth in the unstable phase-space directions but singular in the stable directions, 
which comes from the breaking of the time-reversal symmetry in the forward semigroup. This breaking of time-reversal 
symmetry is here transferred from the diffusive mode to the noncquilibrium steady state. 



r 1 




FIG. 7: Periodic hard-disk Lorentz gas: Curves of the cumulative functions T s (0) = f Q ^ s (F g i) dO' of the nonequilibrium 
steady state for triangular lattices of hard disks of unit radius with an intercenter distance of d = 2.001, 2.1, 2.2, 2.3. The plot 
shows the generalized Takagi function for a gradient in the {/-direction versus the one for a gradient in the x-direction |95||. 



The nonequilibrium steady state l|8l)|l implies Fick's law. Indeed, for a steady state (|80|l with a gradient g in the 
x-direction, the average velocity v x or current is given by 



(«x)neq = (Vx^ejeq = -.9 / (v x (0)v x (t)) cq dt = -V g 



(81) 



where we have used the result that {v x x} cq = 0. Accordingly, we recover the Green-Kubo formula for the diffusion 
coefficient V and Fick's law 291. 
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The expression H80fl for the nonequilibrium steady state can be obtained by a direct reasoning. Let us consider 
diffusion in an open Lorentz gas between two chemiostats or particle reservoirs at phase-space densities p± separated 
by a distance L. The phase-space density inside the system can only take either the value p- corresponding to the 
reservoir on the left-hand side or p + from the reservoir on the right-hand side. In order to determine which value, we 
have to integrate the trajectory backward in time until the time of entrance in the system, T(T) < 0. The value is p- 
(resp. p+) if the particle enters from the left-hand (resp. right-hand) side. If the gradient of phase-space concentration 
is denoted by g, we can write the invariant density of the nonequilibrium steady state in the form: 



Indeed, the integral of the particle velocity v backward in time until the time of entrance gives the position of entrance 
r(<j> T< T''r) = ±L/2 minus the current position r(T) which cancels the first term in the bracket. With the gradient 
g = (p + — p^)e T JL, we end up with the result that p neq (r) = p± whether the trajectory enters from the left- or 
right-hand side |2j|. 

The density of this nonequilibrium steady state is therefore a piecewise constant function with its discontinuities 
located on the unstable manifolds of the fractal repeller of the escape-rate formalism of Sec. IIIII Indeed, trajectories 
on the unstable manifold of the fractal repeller remain trapped between both reservoirs under the backward time 
evolution. The fractal repeller of the escape-rate formalism therefore controls the structure of the nonequilibrium 
steady state. Its invariant density is very different from the one of the thermodynamic equilibrium but it remains 
absolutely continuous with respect to the Lebesgue measure as long as the reservoirs are separated by a finite dis- 
tance L. Furthermore, we notice that the nonequilibrium steady state defined by /x neq („4) = J A p ncq (T) dT with the 
probability density 1|82|) breaks the time-reversal symmetry in the sense of Eq. I|31|) . 

In the limit where the reservoirs are separated by an arbitrarily large distance L, the time of entrance goes to infinity: 
T(T) — > oo. If we perform this limit while keeping constant the gradient g, the invariant density l|82|) is related to 
the density H8()|l after substraction of the mean density (p+ +p_)/2. Therefore, we reach the conclusion that the 
discontinuities on the unstable manifolds of the fractal repeller of the escape-rate formalism gives the singular character 
to the nonequilibrium steady state. There is thus a deep connection between the fractal repeller of the escape-rate 
formalism, the fractal structure of the hydrodynamic modes, and the singular character of the nonequilibrium steady 
state. 



The study of the hydrodynamic modes of diffusion as eigenstates of the Liouvillian operator has shown that these 
modes are typically given in terms of singular distributions without density function. Since the works by Gelfand, 
Schwartz, and others in the fifties it is known that such distributions acquire a mathematical meaning if they are 
evaluated for some test functions belonging to certain classes of functions. The test function used to evaluate a 
distribution is arbitrary although the distribution is not. Examples of test functions are the indicator functions of 
the cells of some partition of phase space. In this regard, the singular character of the diffusive modes justifies the 
introduction of a coarse-graining procedure. This reasoning goes along the need to carry out a coarse graining in order 
to understand that entropy increases with time, as understood by Gibbs |55l | at the beginning of the XXth century. 




We consider a spatially periodic dynamical system as used for the simulation of Brownian motion by molecular 
dynamics with periodic boundary conditions. The particles of the fluid surrounding the Brownian particle are rein- 
jected at the boundary opposite to the one of their exit, while the Brownian particle continues its random walk on 
the lattice made of the images upon spatial transitions of the system around the origin. The phase-space region Ai\ 
corresponding to the image of the system at the lattice vector 1 is partitioned into cells A. If the underlying dynamics 
has Gibbs' mixing property, the probabilities that the system is found in the cells A at time t converge to their 
equilibrium value at long times: 



The knowledge of the Pollicott-Ruelle resonances ±s Q of the forward or backward semigroups l|17|) allows us to 
calculate the approach to the equilibrium values. 

As a consequence of Gibbs' mixing property, the coarse-grained entropy also converges toward its equilibrium value 




(82) 



D. Entropy production and irreversibility 





(83) 



eq 




(84) 



A 
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at rates given by the leading Pollicott-Ruelle resonance l|71|l . 

The time variation of the coarse-grained entropy over a time interval r 

A r S = S t (Mi\{A}) - S t - T {Mi\{-A}) (85) 

can be separated into the entropy flow 

A T C S = S t - T ($- T Mi\{A}) - S t - T (Mi\{A}) (86) 

and the entropy production 

ATS = A T S - A T C S = S t (Mi\{A}) - S t (Mi\{$ T A}) (87) 

The entro py p roduction can be calculated using the decomposition of the time evolution in terms of the diffusive 
modes The idea of this ab initio derivation is the following. First of all, we define a lattice Fourier 

transform as 



G(T,\) = ± J dk e Jkl G(r,k) 



where the wavenumber k belongs the first Brillouin zone B of the reciprocal lattice and \B\ denotes its volume. We 
suppose that the initial probability distribution is a small perturbation R with respect to the equilibrium one: 

po(r,i) = Pcq [i + i? (r,i)] (89) 

The time evolution of this perturbation can be written in terms of the lattice vector d(r,i) of displacement of the 
Brownian particle on the lattice over the time interval t as 

R t (T, 1) = -L / dk F k e ik -[ 1+d ( r ' 4 )] (90) 

l»l JB 

The measure of a cell A C M.\ at time t can be evaluated as 

IM(A) = [ Pt (T, 1) dT = fx eq (A) + -L [ dkF* e* kl C(k, f) e Skt X k(A *) = ^ q (A) + S^ t (A) (91) 

J A l"l JB 

where we have introduced the hydrodynamic measure 

f dT v e ik - d ( r <*) 



IM 

as well as 



J M dT Pcq e^(T,t) 



J M dT Pcq ^^ 

I M dT P*1 



C(k,t)e Skt (93) 



where C (k, t) is a subexponential function of time t while the rate of exponential decay is given by the dispersion 
relation of diffusion 

1 f dT n P «k-d(r,t) 

= }™ W M r d q T ^ 

t - , °° 1 J M dT P<=q 

In the limit t — ► oo, Eq. H92|l for the hydrodynamic measure is similar to Eqs. I|73l) - (|74|) for the cumulative function 
of the hydrodynamic mode. The difference is that we here integrate the singular density v&t over a plain phase-space 
cell A while it was integrated over a phase-space curve in Eqs. H73(1 - (I74|) . In the long-time limit, the hydrodynamic 
measure converges to a value which is invariant under the time evolution. This condition is expressed by the equation 



e SkT Xk(A) = e ik ' d ( r ^ Xk(*~M) 
where d(T_4, r) is the displacement over the time interval r of a point T_4 representative of the cell A. 



(95) 
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The hydro-dynamic measure can now be expanded as a series of the wavenumber 

XkM) = fi cq (A)+ik-T(A)+0{k 2 ) (96) 

The first-order term corresponds to the generalized Takagi function of the noncquilibrium steady state but here 
evaluated over a plain phase-space cell A instead of a curve as in Fig. [7| As a consequence of Eq. (|95|) . this Takagi 
measure obeys 

T(A) = T(*-M) + d(T A , t) (97) 

If the phase-space region M.\ is partitioned into cells {A/} which are sufficiently small, the displacements over 
a time interval r of the trajectories issued from these cells obey the first sum rule: 

J2dj»M) = (98) 

3 

while the coefficients T(Aj) satisfy the second sum rule: 

[djT(^) + T(^-)dj + djdjfXeqiAj)] = 2Vt n cq {M) 1 (99) 

3 

where 1 denotes the identity matrix of the physical space. We notice that this sum rule is a form of the Green-Kubo 
formula. 

Now, the entropy production l|87|) becomes 



i E [MTAf _ i E [W +Qfe ») (100) 



Substituting the wavenumber expansion lj9U|) of the perturbations 8/j t (Aj), using Eq. l|9"7|) and the sum rules (|§8|) - (|§9"|l . 

we finally obtain the fundamental result that the entropy production takes the value expected from nonequilibrium 
thermodynamics 



A[s , TiB pfe^)! (101) 

n 

where n = (i t (M.i ) is the particle density |29l l9rj l97j. This result is a consequence of the singular character of the 
nonequilibrium steady state. It can indeed be shown that the entropy production would vanish if the steady state had 
a density given by a function instead of a non-trivial distribution. In the present derivation from the hydrodynamic 
modes, the singular character of the nonequilibrium steady state is directly coming from the hydrodynamic modes. 
If we consider the nonequilibrium steady state (|82() between two reservoirs of particles separated by a distance L, 
the invariant measure is still absolutely continuous with respect to the Lebesgue measure, although very different 
and much more complicated than the microcanonical equilibrium measure. For finite L, there is a characteristic 
scale below which the continuity of the measure manifests itself. This scale decreases exponentially with the distance 
with respect to the physical boundaries. For a partition into cells which are larger than this characteristic scale, the 
entropy production which depends on the partition takes the thermodynamic value I|1U1|) . Instead, it vanishes for 
smaller cells. In the limit L — > oo, the invariant measure looses its absolute continuity and becomes singular so that 
the thermodynamic value is obtained for cells of arbitrarily small size 29]. In the present derivation starting from 
the hydrodynamic modes, the system is infinite so that the state is singular and the thermodynamic value is also 
obtained for cells of arbitrarily small size [9(| |97j • This shows that the thermodynamic entropy production does not 
finally depend on the chosen partition. 



V. FLUCTUATION THEOREM 



In the present section, we deal with systems in nonequilibrium steady states. Our purpose is to obtain their 
properties such as the mean values of the currents in terms of the affinities (also known as the thermodynamic forces) 
and their fluctuations. These fluctuation properties are expressed in terms of large-deviation functions which obey 
symmetry relations known as the fluctuation theorem j^ll EE EE 0, EE HE HE HE HE HE El • 
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A. Description in terms of a master equation 



In order to maintain a noncquilibrium steady state, the system should be in contact with at least two thermostats or 
chemiostats at different temperatures or chemical potentials. Accordingly, the system is not isolated and its dynamics 
depends on the degrees of freedom of the environment. We expect, on the one hand, a dissipation of energy toward 
the environment and, on the other hand, a reaction of the environment back onto the subsystem in the form of 
fluctuations. As a consequence, boundary conditions should be imposed which introduce in general some stochasticity 
from the boundary coming from the external degrees of freedom. As aforementioned, we are led to a stochastic 
description in terms of some master equation 

^Pt(t»)= lPt(u')W p (L0'\Lu)-P t (L0)W- p (Lu\Lu')} (102) 

for the probability Pt(u>) to find the system in the state u> by the time t. W p (uj\lu') denotes the rate of the transition 
uj — > to' for the elementary process p. There is a transition rate associated with several possible elementary processes 
p = ±1, ±2, ±r. The total probability is conserved Pt{v) — 1 for all times t. 

A graph G can be associated with the random process in which each state ui constitutes a vertex while the edges 
represent the transitions to — * u>' allowed by the elementary processes p — ±1, ±r. Schnakenberg has developed a 
graph analysis of the random processes by considering the cycles C of the graph G [9^ . The method is based on the 
definition of a maximal tree T(G) of the graph G, which should satisfy the following properties: 

(1) T(G) is a covering subgraph of G, i.e., T(G) contains all the vertices of G and all the edges of T(G) are edges 
of G; 

(2) T{G) is connected; 

(3) T(G) contains no circuit (i.e., no cyclic sequence of edges). 

In general a given graph G has several maximal trees T(G) (see Ref. [§3). 

The edges si of G which do not belong to T(G) are called the chords of T(G) . If we add to T{G) one of its chords Si , 
the resulting subgraph T(G) + s; contains exactly one circuit, Ci , which is obtained from T(G) + si by removing all the 
edges which are not part of the circuit. The set of circuits {C%, C2, Ci, ...} is called a fundamental set. An arbitrary 
orientation can be assigned to each circuit C; to define a cycle Ci. A maximal tree T(G) together with its associated 
fundamental set of cycles {Ci,C?2, ...} provides a decomposition of the graph G. We notice that the maximal 

tree T(G) can be chosen arbitrarily because each cycle Ci can be redefined by linear combinations of the cycles of 
the fundamental set. Schnakenberg noticed that the product of the ratios of forward and backward transition rate 
over a cycle is independent of the states of the cycle and can be expressed in terms of the nonequilibrium constraints 
imposed on the system from its environment |98j. These nonequilibrium constraints are expressed in terms of the 
affinities or generalized thermodynamic forces which we shall define in specific cases here below. 

+p 

For isothermal processes, the ratio of the transition rates of a forward and backward elementary processes u> ^ u> 

-p 

typically obeys the relation: 

e^"^) (103) 



W- p (u/\w) 

where X^ denotes the value of the thermodynamic potential corresponding to the situation (see Table II). This relation 
corresponds to an assumption of local thermodynamic equilibrium. 



TABLE II. The statistical ensemble and thermodynamic potential to use 
for the different possible conditions imposed on a system. 



fixed 



quantities 


system 


ensemble 


potential 


X 






V,T 


closed 


isochoric-isothcrmal canonical 


Helmholtz free energy 


F 


= E 


-TS 


P,T 


closed 


isobaric-isothermal 


Gibbs free enthalpy 


G 


= F 


j-PV 


V,T,n 


open 


isochoric-isothermal-isopotential grand can. 


grand potential 


J: 


= F- 


- pN 


P,T,n 


open 


isobaric-isothermal-isopotential 




K 


= G 


- pN 



27 



If we take the product of these ratios over a cycle, we get 



ujEC 



— exp 



which defines the affinity of the cycle. 

In order to fix the ideas, we here consider two simple examples which are found in the biological nanosystem 
Fi-ATPase. The first example concerns the rotational motion of the shaft of the motor by the angle 9 which is the 
state variable. For a given chemical state, the rotational motion takes place in a potential V{9) which induces an 
internal torque T; n t = —8V/89 and under an external torque r ox t- The internal potential V{6) is periodic in the angle 
9: V(2ir) — V(0). Under laboratory experimental conditions, the temperature and pressure are fixed so that the 
potential is a free enthalpy. The affinity of the cycle C corresponding to the full rotation of the shaft by A9 = 2ir is 
thus given by 

A{6) = -pl ^d9 =/3<£ + Text) d9 = 2tt (3 r oxt (105) 



89 J \ 89 

For this example, the affinity is proportional to the external torque which performs some work on the nanosystem and 
maintains it out of equilibrium. Under the effect of an external torque, the Fi-ATPase can synthesize ATP molecules 
from ADP and Pi. The second example is the binding of ATP to the catalytic site of Fi-ATPase: 

ATP + 0^1 (106) 

-p 

The angle 9 is supposed to remain fixed during this elementary process. This is a chemical reaction in which the 
numbers of molecules of the different species change and we have to use the potential K if the process takes place at 
given temperature and pressure. The chemical potential of ATP is fixed by the concentration [ATP] in the environment 
of the Fi-ATPase according to 

A* atp = Matp + k sT In I^ZZI (107) 

c u 

where c° is the reference concentration of one mole per liter while /^ Tp is the corresponding standard chemical 
potential. The ratio (|103fl of the transition rates of the forward and backward elementary processes is given in terms 
of the potential X = K = G — jiN where [i = (iatp and N = Natp denote the chemical potential and number of 
ATP molecules inside the Fi-ATPase. We find that 

AK = K - Kt = G - ij,N -G ± + pNt = G -G 1 + t i = V (9) - Vi{9) + matp (108) 

since No = and Ni = 1. Therefore, the ratio of the transitions rates of these elementary processes should satisfy 

TU. P (1|0)- C c° (iU9j 

For a chemical reaction under isothermal and isobaric conditions, the product of these ratios over a cycle with 
G(2?r) = G(0) will in general be 



n - -P W - =P (?±^(0)) = exp 



A(C) (110) 



so that the affinity of the cycle is here given by the chemical potential difference between the initial and final states of 
the cycle divided by the thermal energy. At equilibrium, this difference of chemical potential vanishes. We conclude 
that nonequilibrium conditions can be maintained by some differences of chemical potential between the reactants 
and the products. This is the case in nanomotors fuelled by chemical nonequilibrium concentrations such as the 
Fi-ATPase in a solution of ATP. 

The master equation admits in general a time-independent stationary solution dP s t (u))/dt — 0. Out of equilibrium 
[i.e., if A(C) 7^ for some cycle C], this stationary solution describes the nonequilibrium steady state. If all the 
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nonequilibrium constraints vanish [i.e., if A{C) = for all the cycles C], the stationary solution represents the 
equilibrium state P cq (cu) which obeys the detailed balance conditions: 

P cq (u')W p (Lu'\Lu) = P^W-pMw') (111) 

which should hold for all the elementary processes p = ±1, ±2, ±r. These conditions are the consequences of 
Boltzmann equilibrium distribution and of the identities l|103ll . This can be checked in the canonical ensemble for 
instance. Indeed, according to the Boltzmann distribution, the equilibrium probability of a state u> is given by 
P eq (uj) = Z~ 1 e~ l3Eu ' = e~^ F " so that the detailed balance conditions (|1 1 If) are satisfied because of Eq. (|l()r?|) with 
X u = . The master equation (|102fl is said to obey detailed balance if it admits a stationary solution satisfying the 
conditions l|lll|) . 



B. Entropy, entropy flow, and entropy production 

The entropy of the system at the current time t can be defined as [3^ 

UJ UJ 

The first term should be included if the graining into the states ui is coarse enough that an entropy S°(tu) is naturally 
associated with them. This is the case if tu represents the number of molecules of each species in the system for 
instance. 

The time variation of the entropy can be decomposed into a term for the entropy flow to the environment and the 
entropy production, in much the same way as done in Eqs. I|85|l - 187|) for the deterministic description [98ll9^ : 



Introducing the currents 



and the affinities 



dS_ _ deS_ <k^_ 

dt ~ dt dt ' ' 



J p (u,u/;t) = P t (uj')W p (w'\cj) - P t (u)W- p (u\u/) (114) 



M^^) = ^ PMw _ Mu)l) (115) 



the entropy flow is here given by 

(116) 



J p( w ' w '^) 



dt 

P,LJ,LJ' 



-^ln^^ 



2 W- p {uj\uj') 



while the entropy production is given by 

(117) 

The entropy production is always non-negative in agreement with the second law of thermodynamics. In a system 
without nonequilibrium constraint, the probability distribution Pt(tu) undergoes a relaxation toward the equilibrium 
state P cq (uj) for which the entropy production vanishes because of the detailed balance conditions (|lllfl . During this 
relaxation, the entropy production is positive. Therefore, the solution of a master equation satisfying detailed balance 
necessarily converges toward the equilibrium state. In a system with nonequilibrium constraints, the relaxation 
proceeds toward a nonequilibrium steady state in which the entropy production continues to be positive. 



C. Fluctuation theorem in nonequilibrium steady states 

The master equation rules the time evolution of a random process, the trajectories of which undergo random jumps 
between the states u>. The jumps occur at successive times: < t\ < £2 < ■ ■ ■ < t m < t. The waiting times — tj 
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on some state uj{t) = (jj are exponentially distributed according to the transition rates. Accordingly, a trajectory or 
path can be represented as 

/,\ PI P2 P3 Pn ('110% 

= cro — >en — *o- 2 — ► ►ov, (118) 

where = Lu(t) for tj < t < t J+1 and pj is the elementary process causing the transition <Jj-\ — > <7j. An alternative 
representation of the trajectory is provided by sampling at regular time intervals tk = kr: 

U)(t) = LOQLO1UO2 ■ ■ ■ ^n- 2 ^n-l (119) 

with ujk = w(fcr). The probability of a trajectory or path in the stationary state is given by 

p, [u(t)] = -P s t(wo) P t (ui -^uji) P T (ui 1 -^u 2 ) ■ ■ ■ P T {u} n - 2 Pj! -$uJn-\) (120) 

where pk — 0, ±1, ±2, .... ±r denotes either an elementary process if pk ^ or the continuation of the current state if 
pk = 0. The conditional probabilities of such transitions are given by 

( Wp{u\uj') t + 0(t 2 ) if p^O 

P T (uMu') = \ (121) 
I 1 - Ef:±i E<y W^k) r + 0(r 2 ) if p = 

Accordingly, the probability of a trajectory 1)120(1 can be approximated as the product of the transition rates multiplied 
by r of the actual transitions crj_i-^-><7j : 

fi[u)(t)] ^P at (a ) W Pl ((7oki)rW P2 (a 1 |cr 2 )T • • • W^K^a™) r (122) 

with <7o = wo and cr m = Lu n -i- In the case pk = 0, no transition occurs in the corresponding time interval r, which 
contributes by a factor of order one in r. Similarly, the probability of the time-reversed trajectory or path is given 
by 

H [io K {t)} ~ P st (<j m ) W- Pm (<T m \a m -i)T-~W- pa (iT2\<Ti) r W- P1 (ax\a ) r (123) 

In order to evaluate how detailed balance is satisfied along a trajectory, we can introduce the fluctuating quantity 

2ru\=] w pi{^Wi) w P2^iW2) ■ ■■W Pm (a m - 1 \g m ) 
[> ~ W- pl fa\<T )W- Pa fa\v 1 )-->W- Pm (<T m \tr m -i) [ ' 



following Lebowitz and Spohn |36l l38| . The denominator of Eq. (|124|) is the product of the rates of the transitions 
which are time reversed with respect to those appearing in the numerator. Therefore, the quantity l|124|) is defined in 
terms of the product of the ratios 1(103(1 between the forward and backward processes at each jump event along the 
trajectory (0 < t\ < t 2 < ■ ■ ■ < t m < t). 

If the process is isothermal and if Eq. I(103|) holds, the quantity 1124|) is given by Z{t) = P{X ao —X 0m ) — (3(X — X t ) 
where the potential X is defined in Table II. If the system is at equilibrium, we expect that X t is distributed as X$ so 
that (Z(t)) ~ in agreement with the fact that detailed balance is satisfied at equilibrium. In constrast, we expect 
a nontrivial behavior of the fluctuating quantity Z{t) out of equilibrium. Furthermore, we notice that this quantity 
can be written in the long-time limit as 

1 MK*)] Morn 

Z{t) ^ ln j^m\ (125) 

in terms of the multiple-time probabilities of the path ui(t) and time-reversed path u) R (t) entering the definitions of 
the dynamical entropies ((49(1 and ((51(1 . Indeed, the numerator in Eq. ((125(1 is the measure ((122(1 of the path itself 
while the denominator is the measure l(123|) of the time-reversed path and the boundary term In [-P s t(oo)/P s t(cr m )] 
becomes negligible in the long-time limit with respect to the sum of the other terms which increases linearly with 
time. Accordingly, we recover the definition l(124|) after neglecting the boundary term in the long-time limit. 
In order to characterize the large-deviation properties of Z(t), its generating function can be introduced as 

Q(rj) = lim --hx{e~ r ' z ^) (126) 



where the average is carried out in the nonequilibrium steady state. 
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According to the result ^ 125(1 . we have the following succession of equalities 



A*K*)] 



1-7) 



-(l-r,)Z(t) 



where the third equality uses the fact that summing over the time-reversed paths is the same as summing over the 
paths since both sums cover all the possible paths. If we substitute the result 1|127|) in the generating function (|126fl . 
we obtain the so-called fluctuation theorem 



Q{rj) = Q{1 - r?) 



(128) 



A consequence of the fluctuation theorem l|128|> and of the definition (|126|) is that Q(0) = Q(l) = 0. 

We now consider the large-deviation function defined as the rate of exponential decay of the probability that the 
quantity — ^ takes its value in the interval (£, C + <^C) : 



Z(t) 



e (CC + O 



-R(C)t 



(129) 



This large-deviation function is related to the generating function (|126f) by the Legendre transform 

R(C) = max, [Qfa) - C v] (130) 
The fluctuation theorem (|128|l has for corollary that the large-deviation function (|129fl satisfies the identity 

(131) 



C = R(-Q - R(0 



or equivalently that 



/'■ 



^e(-C,-C + dC) 



for t 



(132) 



In the form l|131|) . the fluctuation theorem appears as a large-deviation relationships very similar to the escape-rate 
formula l|t)8|) . Indeed, we find in the left-hand member an irreversible property (here £) and in the right-hand member 
the difference between two large-deviation quantities which here are two decay rates of multiple-time probabilities. 
We shall further comment on this connection in the conclusions. 

Now, the mean value of the fluctuating quantity Z(t) can be interpreted in terms of the entropy production here 
defined by Eq. (|117|) . Indeed, Eq. (1 12411 can be transformed as follows: 



Z(t) = In 



P((7l)W- pl (a 1 |f7o) J P(T 2 )VK_ p2 ((7 2 | ( 7o)---P(fT m )VK_ Pm (CT m | ( 7 m _l) 



hi 



P(*o) _ 
P{o- m ) ^— \ 

7 = 1 



(133) 

in terms of the affinities (|1 15|> associated with each random jumps. Since these events occur on average at rates given 
by the currents (|114f> . the statistical average of the quantity Z(t) is given by 



(134) 



according to Eq. I|117|) . As a consequence, the mean rate of linear increase of the fluctuating quantity Z gives us the 
entropy production rate in a nonequilibrium steady state: 



djS 
~dt 



= fc B lim Uz{t))=ka ^-(0) 
s t t— >oo t dr\ 



(135) 
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D. Fluctuation theorem for the currents and consequences 



A nonequilibrium steady state is maintained by currents between the system and reservoirs (thermostats or 
chemiostats). The number of independent currents is equal to the number of independent differences of chemical 
potentials between the chemiostats. Schnakenberg graph analysis and the equality l|ll)4|) show that the nonequilib- 
rium constraints are hidden in the product of the ratios of forward and backward transition rates along the cycles of 
the graph associated with the process . A graph has many possible cycles C but the corresponding affinities take 
a number of different values limited by the number of independent nonequilibrium constraints, A{C) — A 7 for C £ 
For an isothermal reactive process between a chemiostats, we have only a — 1 different values A~ l = A/i 7 /(/cBT) 
We denote by j 7 (i) the instantaneous current corresponding to the nonequilibrium constraint 7. The mean value of 
this instantaneous current is related to the currents (|1 14|) by 



O7) 



lim — 



(136) 



The instantaneous currents jj(t) fluctuate in time and their fluctuation properties can be studied thanks to their 
generating function defined as 



Q({ Vy };{A 7 })= lim -- ln(e _ E-r"^ /o 

t — >oo t 



If we define A 7 = A~ ( r]~ n the generating function l|137fl becomes 



g({A 7 };{y4 7 }) = Q({A 7 /A 7 }; {A,}) = lim -Itye-^ISMW) 

t— >oo I 



(137) 



(138) 



which shows that the statistical moments of the instantaneous currents j 7 (t) can be generated by successive differen- 
tiations. In particular, the mean flux or rate of the overall process 7 is given by 



dq 



Now, the generating function obeys the fluctuation theorem for the currents |39l I40L Elj : 



9 ({A 7 }; {A 7 }) = q({A 7 - A 7 }; {^L 7 }) 



(139) 



(140) 



Pi 



This result can be obtained by giving the exponent r/j — r/ 7 each time a random jump ov—i-^Oj concerns a transition 
in a cycle C £ 7 and a vanishing exponent rjj — otherwise. In this way, a calculation similar to Eq. I|127|l can be 
performed as follows: 



<"(*) 3 



'A; 



:E^(*)]II 

«(t) j 



W P] {<Tj-l\<Tj) 



: E MfwWlII 

w R (t) j 



=5>M*)iII 

w(t) j 

W- Pi (<r s \(r S -x 



W-P 3 -(*j>j-i). 



n 



W w (o-i-i|o-,-) 



1-% 



which establishes the results (|14Ufl ■ A full proof is given in Ref . jijj • 

The fluctuation theorem has important consequences on the coefficients of the expansion of the average currents as 
Taylor series of the associated affinities 



J a = ^ L a pAp + ^ E M aM A P A l + \ E NafrsApAyAs + • • ■ 



(142) 



The linear response of the fluxes J a to a small perturbation in the affinities Ap is characterized by the Onsager 
coefficients L a p, and the nonlinear response by the higher-order coefficients M a p 7 , N a p^s,--- 

The Onsager reciprocity relations can be derived from the fluctuation theorem as follows. The Onsager coefficients 
are given by differentiating the generating function: 



L a /3 — 



dJ a 
OA, 



d 2 q 
d\ a dA, 



-(0;0) 



(143) 
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If we differentiate the expression H140fl of the fluctuation theorem with respect to X a and Ap and set {A 7 = 0} and 
{Ay = 0}, we find the Green-Kubo relations and the Onsager reciprocity relations: 

LaP = ~\ dSk~p {0; 0) = l CI {liait) ~ {ja)] fo(0) _ (i/5>])eq * = Lpa (144) 

If we carry out a similar reasoning for the higher-order coefficients, we obtain the third-order response tensor 

M ^ S dxJdidA^ = 2 (^.7 + ^) (145) 



d 3 q , , 1 

MaPr > = dX a 

with the quantities 



d 3 q d f +co 

R <*^ = ~ m STfll 0; 0) = — / (b Q (t) - (j a > fo>(0) - 0> st dt (146) 
0\ a d\pdAy dA 1 J_ 00 {A s =o} 

which are the derivatives of the no neq uilibrium generalizations of the Onsager coefficients L a p. Similar results hold 
at fourth and higher orders |39l l40l Hlj . 

E. Connections to the nonequilibrium work relations 

Beside the fluctuation theorem for nonequilibrium steady states, other relations have been obtained such as Jarzyn- 
ski's nonequilibrium work theorem |43| . These relations concern the work performed on a system by varying in time 
some external control parameter X(t) from an initial value A(0) = X A to a final one A(tfi na i) — Xb- To be specific, the 
system can be supposed to be initially in the canonical ensemble 

po(T) = J- exp [-/3H(T, X A )} (147) 

where H(T, X) is the Hamiltonian of the total system including the small subsystem of interest (e.g. a protein or 
a RNA molecule attached to beads or to an AFM) and its environment (e.g. the surrounding solution). The work 
performed on the system is defined by 

W= [ dtXdxH[T(t),X(t)}=H(T B ,X B )-H(T A ,X A ) (148) 

J A 

where and Tb denote the phases of the system at the initial and final times along the Hamiltonian trajectory. 
Under such assumptions and following Jarzynski [4sT |. it is possible to derive, from Liouville's equation for Hamiltonian 
systems, the nonequilibrium work theorem: 

(e-^) = e" /3AF (149) 

in terms of the difference AF = Fb — F A = —k^T \h(Zb /Z a ) of the free energies calculated at equilibrium for A = Xb 
and X = X A respectively. A remarkable result is that Jarzynski's equality 1149(1 implies Clausius inequality 

(W) > AF (150) 

because of the general inequality (e x ) > e^. If the work dissipated by the irreversible processes is defined as 
Wdiss = W - AF, Eq. (|r4l?j> takes the form 

( e -/3W di3B ) = 1 (151) 

Crooks has obtained the other relation [3f|: 

Pf(W) = e ^ w - AF ) = e^ Wdl - (152) 

where pp is the probability density that the work (|148fl takes the value W during the forward process A — ► B, while 
is the corresponding probability density for the reversed process B — > A. Equation i|152[l can be derived in the same 
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Hamiltonian framework as Jarzynski's equality. Indeed, by using Liouville's theorem (Wa — dT B and by noticing 
that the work performed during the reversed process is given by Eq. (|148fl with A and B exchanged, we find that 



Pf 



(W) = J dT A^ e"^ S [W - (H B - H A )] = J dT A ±- e ~^ B -w) g { _ w _ {Ha _ Hg)] 

[ dT B J- e-P HB S {-W - (H A - H B )\ = c^ AF c^ w PR (-W) (153) 



Zb_ e/3W 



Z A 

Jarzynski's nonequilibrium work theorem is a consequence of Crooks' relation because the average in Eq. 1 149(1 can 
be expressed in terms of the probability density of the work during the forward process according to 



e 



0W ) = / dW p F (W) e~P w = e-P AF / dW pr(-W) = e~ f3AF (154) 



hence Eq. 1149(1 . Similar relations can be obtained for the other statistical ensembles of Table II. The microscopic 
Hamiltonian H should be replaced by H + PV in the isobaric-isothermal ensemble, by H — fiN in the grand canonical 
ensemble, and by H + PV — /j,N in the isobaric-isothermal-isopotential ensemble. These relations can be used to 
obtain the differences of the corresponding thermodynamic potential from the statistics of the work performed on the 
system during general nonequilibrium transformations. 

Crooks' fluctuation theorem is closely related to the so-called transient fluctuation theorem by Evans and Searles 

mini. 

Both Eqs. ((149(1 and 1(152(1 are also related to the fluctuation theorem for nonequilibrium steady states of isothermal 
processes. Indeed, we have shown that the quantity 1(124(1 has its generating function which satisfies Q(l) = so that 
we have the property that (e" z ^) has a subexponential behavior for t — > oo. Comparing with Jarzynski's identity 
l(151(l . we can thus identify the quantity Z(t) with the dissipated work in the long-time limit: 

Z ~ p W diss (155) 

so that Eq. ((135(1 implies 

cks = i Um M 

at st T t-+oo t 

as expected, where T denotes the temperature. For the same reason, Crooks formula corresponds to the stationary 
fluctuation theorem in the form ((132(1 with Qt ~ (3 Wdi ss (t) in systems where the external constraints are stationary 
and the forward process is the same as the reversed one. In conclusion, Jarzynski's and Crooks' relations are general 
results on the statistics of the work dissipated by a system during a nonequilibrium process and they arc closely 
related to the fluctuation theorem for nonequilibrium steady state. They constitute constraints on the nonequilibrium 
properties but they do not determine by themselves the characteristic times of the nonequilibrium processes as rates 
can do. These nonequilibrium work relations have important applications in the study of nanosystems. They have 
recently been used to measure experimentally the folding free energies of proteins and RNA molecules d, . 

VI. ENTROPY PRODUCTION AND DYNAMICAL RANDOMNESS 

A most remarkable recent result is that entropy production can be related to the forward and backward dynamical 
randomness of the trajectories or paths of the system as characterized by the entropies per unit time ((491) and 1511) 
|45j . It is possible to show that the entropy production in a nonequilibrium steady state is given by the difference 
between these two dynamical entropies: 



^ = fc B (h R h) > 



(157) 



for a given partition P . The right-hand side is always no n-neg ative because the difference of both dynamical entropies 
is a relative entropy which is known to be non- negative |l00| . 

Here below, this further large-deviation relationship is demonstrated for processes ruled by the master equation 
((102(1 . If the trajectories of this process are sampled with the time interval r, the multiple-time probability of a path 
((119(1 is given by Eq. 1(120(1 . Using the definition 1(49(1. the entropy per unit time becomes 



h(T)=(ki~) J2 P*t(u)W„(u>\u/) - fttMW^Mu/) In WpMa/) + 0(r) (158) 
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This is a function of the sampling time r because the process is continuous in time and the waiting times between the 
jumps are exponentially distributed p9l l80|. This function characterizes the dynamical randomness of the random 
paths followed in the forward direction. 

The time-reversed entropy per unit l|51[) is given by an expression similar to Eq. I|158f) but with the exchange 
lu <-> uj' in the transition rate appearing in the logarithm |45|: 



h K (T) = (bx-j P«(u)W p (u\u') - P*(w)W p (w\u/)\n.W p (u/\w)+0(r) (159) 



This other dynamical entropy characterizes the dynamical randomness of the time-reversed paths. 
The difference between both dynamical entropies is 

^{r)-h{r) = \ ]T [P«V)W P V\w)-P«{u)W-M<</)] ln p'^W^M ' ^ + °^ ( 16 °) 

i ' r st (U W- p {LO U! ) 

p 7 u) 7 u' 

where we observe the same expression as in the definition (|117|l of the entropy production. Hence we find Eq. I|157|) 
in the limit r — > |45j . 

This fundamental result establishes a connection between the entropy production and the dynamical randomness 
of the stochastic process. We notice that both dynamical entropies should be equal, h R — h, if the system was 
at equilibrium. In contrast, a difference exists between them in nonequilibrium steady states. This shows that 
the dynamical randomness of the time-reversed trajectories is higher than the one of the forward trajectories. This 
breaking of time-reversal symmetry at the level of the dynamical randomness has its origin in the boundary conditions 
imposed to maintain the nonequilibrium steady state. As we have pointed out with Eq. 1|31|) and explicitly showed 
in Subsec. IIV CI these boundary conditions typically break the time- reversal symmetry of the measure describing a 
nonequilibrium steady state. This breaking manifests itself in the dynamical randomness of the process as shown by 
Eq. (tTTT7l . 

This result can also be derived for deterministic systems where the entropy per unit time is equal to the sum of 
positive Lyapunov exponents according to Pesin's formula while the time-reversed entropy per unit time appears to be 
equal to minus the sum of negative Lyapunov exponents. In dynamical systems which model thermostated systems, we 
thus recover the result that minus the sum of all the Lyapunov exponents, i.e., the phase-space contraction rate, should 
be interpreted as the entropy production. However, the introduction of the time-reversed dynamical entropy and Eq. 
(|157fl also apply to systems without Lyapunov exponents (for instance in the so-called non-chaotic Hamiltonian 
systems made of polygonal billiards provided that they are open and crossed by fluxes of particles between reservoirs) . 

Moreover, the formula i|157fl establishes a fundamental relationship between entropy production and the way in- 
formation is processed by a nonequilibrium system. According to the Shannon-McMillan-Breiman theorem [56|. the 
multiple-time probability of a path decays as 

= K^i-^n-i) ~ e~ nTh ^ (161) 

for almost all the trajectories if the process is ergodic. In contrast, for a typical path of the process, the probability 
to find the time-reversed path decays faster as 

M (w R ) = mK-l.-u^o) ~ e~ nThR W (162) 
According to Eq. (|157fl . the ratio of both multiple-time probabilities typically decays as 



g fcg dt — — g fcg 1 ^ f 1631 

at a rate given by the entropy production. This result shows that nonequilibrium constraints on a system perform 
a selection of trajectories. The probability of the typical trajectories decays more slowly than for the time-reversed 
trajectories. Therefore, the process observed forward in time turns out to be more ordered than the process ob- 
served backward because of the inequality h < /i R under nonequilibrium conditions. It is remarkable that this effect 
of nonequilibrium temporal ordering is active already close to equilibrium and does not need a threshold in the 
nonequilibrium constraints as it is the case for the nonequilibrium ordering into the Glansdorff-Prigogine dissipative 
structures. 

Moreover, the entropy per unit time h can be interpreted as a rate of production of information by the process. 
Indeed, it is the rate at which information should be recorded during the observation of the trajectories of the system 
in order to reproduce its time evolution. We can conceive that this connection has implications for processes involving 
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biological information as in genetics. In this regard, Eq. I|157|) already shows that the nonequilibrium conditions 
naturally lead to a selection in the path or history of the system and to the generation of temporal order. This 
temporal order manifests itself at the level of the information about the time evolution of the paths or histories of the 
system as referred to in Eq. I|157|) . This opens the way to possible feedback if a mechanism of polymerization internal 
to the system can transfer temporal information into the spatial information contained in an aperiodic polymeric chain 
and vice versa. For this to happen, nonequilibrium conditions are required beside the existence of the aforementioned 
mechanism allowing the transfer of information between a spatial encoding and the temporal development of the 
process. Further consequences of Eq. (|157|l about the processing of information in physical processes have been 
discussed in Ref. . 

In this perspective, Eq. (|157l) provides for the first time an interpretation of the second law as a principle of ordering 
and this even for systems close to equilibrium. The usual interpretation of the second law is that the spatial order 
tends to decrease during the time evolution since the entropy increases and is interpreted as a measure of the spatial 
disorder in the system. Here, in contrast, we see that entropy production leads to temporal order in the sense that 
the entropy per unit time is smaller than the time-reversed one. This temporal order finds its origin in the decrease 
of spatial order in the total system composed of the subsystem and its environment in agreement with the usual 
interpretation of the second law. The remarkable result is that the concepts of dynamical entropies coming from 
dynamical systems theory and chaos theory provide a framework in which this new understanding of the second law 
as a principle of temporal ordering can be established. 

VII. APPLICATIONS TO NANOSYSTEMS 

In this section, we apply the previous methods of nonequilibrium statistical mechanics to nanosystems. 



A. Friction in sliding carbon nanotubes 



Two carbon nanotubes embedded one inside the other can slide in a telescoping motion. Indeed, they interact by 
van der Waals attractive forces which causes the system of double-walled nanotubes to increase the number of van 
der Waals bonds by decreasing their total length. This leads to an oscillatory motion in a V-shaped potential for 
the distance between the centers of mass of both nanotubes. However, the double-walled nanotube system has many 
degrees of freedom beside the distance between the centers of mass. Therefore, the dissipation of energy is possible 
from the translational motion in the aforementioned one-dimensional potential to the many vibrational degrees of 
freedom of each nanotubes. This dissipation is caused by friction between both nanotubes |15|| . 
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FIG. 8: (a) The double-walled carbon nanotubes (4,4)@(9,9) with Ni = 400 and N 2 = 900 carbon atoms; (b) Dissipation of 
the energy E of the one-degree-of-freedom translational motion of the centers of mass with respect to the resting configuration 
at T — 300 K. The nonvanishing final energy is due to the heating. The dashed line is the exponential decay of the energy at 
the rate 2£/(3/i) predicted by the model 11651 for a V-shaped potential V(r) ~ F\r\ pUf. 
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The dynamics of the whole system and the irreversible property of friction can be studied by molecular-dynamics 
simulation from the total Hamiltonian 



N, No 



H = T« + + Kg + < + E E Vu (||r« - rf ||) (164) 

i=i j=i 

where and T^ 2 ) are respectively the kinetic e nergi es of the inner and outer nanotubes while and U^b are 
the Tersoff-Brenner potentials of both nanotubes |lOl| . The positions and momenta of the carbon atoms of both 
nanotubes are denoted by {v\ and {p< with a = 1 (resp. a = 2) for the inner (resp. outer) tube. The 

kinetic energies are given by = {l/2m)J2? = : l (P < l a) ) 2 , where m = 12 

amu is the mass of a carbon atom. The 
intertube potential is modeled by a 6-12 Lennard- Jones potential. Systems containing about 1300 carbon atoms can 
be simulated (see Fig. [SJ. The study shows that the translational motion is well described by a Langevin-type 
Newtonian equation 

V r = - ( r + F auct (t) (165) 
ar 

where r is the distance between the centers of mass and \i = NiN 2 m/ (Nx + N 2 ) is their relative mass. V(r) is the 
van der Waals potential of interaction between both nanotubes which has a V-shape. The friction coefficient is given 
by Kirkwood formula 

C [ dt [<F vdW (i)Fvdw(0)} - (F vdW ) 2 ] (166) 



in terms of the time integral of the time autocorrelation function of the van der Waals force between both nanotubes. 
This autocorr elation functio n should be integrated in time until a cutoff time r where the time integral reaches a 
plateau value [Tol Eol Ho^ . 

Moreover, a fluctuating force is required to describe the last stages of energy dissipation when the vibrational 
degrees of freedom cause small amplitude fluctuations in the motion of the centers of mass. On time scales longer 
than the characteristic time of the vibration (about 50 fs) the fluctuating force can be assumed to be a Gaussian white 
noise so that the process can be described by the Fokker-Planck equation (|37|l restricted to one degree of freedom and 
with the friction coefficient (|166fl . The Langevin equation (|165l) and the corresponding Fokker-Planck equation 13 7|) 
describe the damping of the oscillations. The period of oscillations is about 10 ps while the relaxation time of the 
order of 1000 ps. Accordingly the oscillations are underdamped in this system. If the friction was larger, the inertial 
term in the left-hand side of Eq. I|165|) would be negligible and the motion would be overdamped and ruled by the 
equation, £ r = —(dV/dr) + ffl uct (t), which would be the case if the system was embedded in a liquid for instance. 

It is quite striking that such a nanosystem can already present an irreversible property such as the relaxation toward 
a microcanonical state of equilibrium under the effect of some kind of friction. This friction is here present in a system 
of about a thousand atoms. 

The preceding nanosystem undergoes a simple noncquilibrium process of relaxation toward a state of equilibrium 
because of friction. The reason is that energy is not injected to drive its motion as it is the case in the nanomotor 
of Ref. 01 which uses multiple-walled carbon nanotubes as shaft and electrostatic forces for driving. In this case, 
rotational friction dissipates the energy injected by the external driving. 



B. Biological nanomotors 



Energy can also be injected by chemical fuel as in biological nanomotors such as Fi-ATPase which is able to drive 
the rotational motion of an actin filament or beads glued to its shaft 0, • Such a nanosystem may be found in 
different chemical states depending on whether ATP is bonded to one of the catalytic sites of the protein complex or 
has been converted into its products ADP and inorganic phosphate Pi. In each chemical state, the shaft of the motor 
is submitted to an internal torque deriving from some free-enthalpy potential V a (6) which depends on the angle 9. 
The motion of this angle is described by a Langevin-type equation 

C^ = — ^+r«t + 7Buct(*) (167) 

where T cxt is some external torque while Tfl uct (i) is the fluctuating torque due to the environment and which can be 
taken as a Gaussian white noise related to the friction £ by the fluctuation-dissipation theorem. Since the motor 
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can be in different chemical states which change at each reactive event, the potential V a randomly jumps with the 
chemical state a. The mechanical motion of the shaft is thus coupled to the chemical reaction in such mechano- 
chemical processes. The master equation is here a set of coupled Fokker-Planck equations including terms for the 
description the random jumps between the discrete chemical states a: 

d t p a {e,t) + d e Ja = J2 IMM) Wp^^S) -p*(8,t) W- p ^{6)\ (168) 

p,er' 

where p&(9, t) is the probability density to find the motor in the chemical state a and the angle 9 at time t and 

J a = -T>d ePcr + ~(-d e V a +T ext )p< 7 (169) 
with the diffusion coefficient V = k-QT/C, |105| . 




time (s) 

FIG. 9: Examples of trajectories showing the rota tion of the shaft of the Fi-ATPase motor with a glued bead of diameter 
d — 40 nm for different concentrations of ATP |106| . 



The transition rates can be determined by Arrhenius law so that Eq. (|109|) can be satisfied. Such master equations 
fall into the framework described here above, which allows us to obtain the thermodynamics of the nanomotor, in 
particular, the entropy production and the average currents which are here the mean rotation rate of the shaft and 
the mean rate of ATP consumption or synthesis. These average currents depend on the affinities or generalized 
thermodynamic forces which are here the difference of chemical potentials between the reactants and products as well 
as the external torque. The equilibrium state is defined as the situation where the ATP hydrolysis 

ATP ^ ADP + Pi (170) 

has reached equilibrium. This corresponds to the equilibrium concentrations obeying 

[ATP]cq = cxp ~ 4.5 10- 6 M- 1 (171) 



[ADP] cq [Pi] cq " k B T 

with the standard chemical potential difference A/i° = —30.5 kJ/molc = —7.3 kcal/molc = —50 pN nm. For instance, 
the absence of the product immediately drives the system out of equilibrium and causes the rotation of the shaft. 
Figure El depicts the nonequilibrium rotation of the shaft of t he Fi-ATPase motor with a glued bead of diameter 
d — 40 nm simulated by a model with six chemical states |106| . We observe that the rotation proceeds by app aren t 
jumps. The fluctuations of the rotation of the motor are ruled by the fluctuation theorem, as shown elsewhere |107| . 
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C. Fluctuation theorem in nonequilibrium chemical reactions 



Here, we illustrate the application of the fluctuat ion theore m to nonequilibrium chemical reactions 38] . For this 
purpose, we consider SchlogPs trimolecular reaction |l08l [l09] 



A ^ X 

k-i 



3X % 2X + B 

k- 2 



(172) 



The reaction <|172|) presents a phenomenon of bistability at the macroscopic level. In the macroscopic description, the 
mean concentration of X shows a hysteresis between two macroscopic steady states at low and high concentrations. In 
contrast, the stochastic description at the nanoscale takes into account the molecular fluctuations so that the number 
X is randomly distributed over a range of values. The probability distribution P st (X) in the nonequilibrium steady 
state corresponding to bistability presents two maxima reminiscent of the two macroscopic steady states. Accordingly, 
the mean value (X) interpolates between the two macroscopic values. A similar behavior happens for the entropy 
production depicted in Fig. llOfa . The quantity Ijl24|l can be computed along a random trajectory. In the bistable 
regime, Z(t) alternatively increases at the entropy production rates given by the lower and upper states as seen in 
Fig. ITUb . Its generating function Q(r]) has the symmetry of the fluctuation theorem as shown in Fig. HUl . Close to 
equilibrium, the quantity Z(t) wildly fluctuates in time with only a slow increase in contrast to far-from-equilibrium 
situations where the fluctuations are negligible with respect to the increase, as seen in Fig. HUb . The faster the 
increase the larger the entropy production rate. 
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FIG. 10: (a) Entropy production versus the control concentration [B] in the Schlogl model (11721 for fc+i[A] = 0.5, fc_i = 3, 
and k+2 = k-2 = 1, obtained from the macroscopic kinetic equation (dashed lines) and in the stochastic description with 
fl — 10 (solid line), (b) Stochastic time evolution of the quantity Z(t) in the Schlogl model l|172|l with fc+ifA] = 0.5, fe_i = 3, 
k+2 — k-2 = 1, [B] = 4, and Q — 10. The increase of Z(t) fluctuates between the entropy production rate of the lower (long- 
dashed line) and upper (dashed line) stationary macroscopic concentrations, (c) Generating function l|126|l of the fluctuating 
quantity Z(t) versus r] in the Schlogl model 1172H for fc+i[A] = 0.5, k-i = 3, fc+2 = k-2 = 1, [B] = 1, 2, 6, and £1 = 10. The 
thermodynamic equilibrium is located at [B] cq = | where Q{rf) = 38]. 



Fully irreversible reactions happen when the nonequilibrium constraints are so high that some reversed reactions 
never occur. This is the case if one of the reaction constant vanishes, fc_ p = 0, although the constant of the reversed 
reaction does not, k p =/= 0. In such fully irreversible reactions, the entropy production is infinite, which can be 
understood as the limiting case where the quantity Z(t) steeply increases very far from the equilibrium. 



D. Nonequilibrium chemical clocks at the nanoscale 

In this subsection, we consider a far-from-equilibrium chemical reactions which is fully irreversible so that the 
entropy product ion i s here infinite. This reaction is the abstract model of chemical clock known under the name of 
the Brusselator |ll(1 ]: 

-^X, X-^-Y, 2X + Y^3X, X^ (173) 

This reaction is supposed to evolve in a homogeneous system. Because of the molecul ar fluctua tions, it is described 
by Nicolis' master equation which can be simulated by Gillespie's numerical algorithm |llll Ill2fl . At the macroscopic 
level, the Brusselator presents an oscillatory regime beyond a Hopf bifurcation giving birth to a limit cycle, which 
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is a periodic solution of the macroscopic kinetic equations. At the nanoscale, such a limit cycle is noisy so that 
the successive oscillations are no longer perfectly correlated in time. In order to measure the effec t of noise, we can 
compute the time autocorrelation of the number of molecules of one species as depicted in Fig. El |H3j | . We observe 
that the autocorrelation function presents oscillations which are damped exponentially at a rate which is inversely 
proportional to the extensivity parameter f2. The larger the system, the longer the correlation time of the oscillations. 
Accordingly, the oscillations should not be expected to remain correlated if the system is too small. It turns out that 
the oscilla tions remain correlated down to systems containing about one hundred molecules, which corresponds to the 
nanoscale |l!3j . Therefore, we may expect that chemical clocks exist down to the nanoscale in agreement with the 
experimental observation of such chemical clocks in heterogeneous catalysis at the nanoscale [Tsj . 




FIG. 11: Simulations of the Brusselator in the oscillatory regime by Gillespie's algorithm for the parameter values ki = 0.5, 
&2 = 1.5, ks = ki — 1 and the extensivity parameter Q — 1000. The left-hand plot shows the phase portrait in the plane of 
the number of molecules of species X and Y. The middle plot shows the number of molecules X as a function of time. The 
right -hand plot shows the autocorrelation function of the number of molecules X and its decay due to the molecular fluctuations 



VIII. CONCLUSIONS 



As the previous examples show, noncquilibrium statistical mechanics fruitfully applies to nanosystems in order to 
determine their thermodynamic properties. These new developments are challenging for statistical mechanics and are 
bringing fundamentally new concepts for the understanding of the irreversible processes and the second law. 

Nanosystems can be isolated, closed, or open. In isolated nanosystems, the equilibrium state is microcanonical as 
it is the case in dynamical systems theory of Hamiltonian systems. However, many nanosystems are in contact with 
heat or particle reservoirs. In these cases, they are submitted to the motion of the degrees of freedom external to the 
system and, moreover, particles can enter and exit open systems. In this latter case, Liouville's equation leads to a 
hierarchy of equations for the different numbers of possible particles in the system as we have shown in Subsec. Ill Gl 

The new advances concern the large-deviation dynamical relationships which have been obtained during the last 
fifteen years and the possibility of ab initio derivation of the entropy production from the underlying Hamiltonian 
dynamics [USUI- 

First of all, the relaxation toward the state of thermodynamic equilibrium can be understood with dynamical systems 
theory and the concept of Pollicott-Ruelle resonance which naturally shows how the time-reversal symmetry can be 
broken at the statistical level of the description in systems with sensitivity to initial conditions. The Pollicott-Ruelle 
resonances give the relaxation rates which are intrinsic to the dynamics. The associated eigenstates can describe the 
hydrodynamic modes which have only been considered at the phenomcnological level of description and within kinetic 
theory. The use of the new concepts allows us to avoid approximations and to convince oneself of the dynamical origin 
of these modes. The surprise has been that these modes are singular which justifies the use of coarse graining. In 
particular, the diffusive modes can only be represented by their cumulative functions which form fractal curves. The 
fractal dimension is determined in terms of the diffusion coefficient. The singular character of the hydrodynamic modes 
turns out to be fundamental to obtain a non- vanishing entropy production. Remarkably, the direct calculation starting 
from Gibbs' coarse-grained entropy leads to the entropy production expected from nonequilibrium thermodynamics 
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and this even in systems with many particles |97j . This cannot be a simple coincidence and suggests its generalization 
toward the other transport properties such as viscosity and heat conductivity. 

Of great importance is the discovery of a series of fundamental large-deviation dynamical relationships in different 
approaches: 



• the escape-rate theory |21ll24l I25ll2al88j: 

• the theory of the hydrodynamic modes of diffusion [92, 0, Ill4| ; 

• the fluctuation theorem 

m m s h m m m m m m im ; 

• the relationship between entropy production and dynamical randomness in nonequilibrium steady states |45j | . 

These relationships all share the same structure that an irreversible property is given as the difference between two 
large-deviation quantities of the microscopic or mesoscopic dynamics. 

In the escape-rate formalism which is concerned by nonequilibrium systems with absorbing boundary conditions, 
the leading Pollicott-Rucllc resonance is the escape rate which is proportional to the transport coefficient and given 
by Eq. (|68[) as the difference between the sum of positive Lyapunov exponents and the Kolmogorov-Sinai entropy. 
For diffusion, we get 0,113 

V(^) 2 ^ 1= (^A.-ZiKs) (174) 

\A S >0 / r 




and for viscosity or other transport coefficients |2lL |2j 

(175) 

Very similar relationships are obtained for the hydrodynamic modes of diffusion in the two-dimensional Lorentz gases 
where the dispersion relation Sk is also the leading Pollicott-Ruelle resonance ^jj^ 

ve * -Re Sk = A(D H ) - *<^5) (176) 

by Eqs. I|77|l and i|tj2fl . In these relations, the transport coefficient is given in terms of the difference between the 
positive Lyapunov exponents and the Kolmogorov-Sinai entropy per unit time which characterizes the dynamical 
randomness. 

For nonequilibrium steady states, the fluctuation theorem l|131fl 

C = R(-0 - R(0 (177) 

has again the same structure as Eqs. (I174fl - (|176|) with an irreversible qua ntity such a s C in the left-hand side and the 
difference between two decay rates of probabilities in the right-hand side [^I^l^l^l37l l33.l39ll40ll4l | . 

Finally, the entropy production in nonequilibrium steady states can be given in terms of the difference between two 
quantities characterizing the dynamical randomness of the underlying dynamics, namely, the entropy per unit time 
of Kolmogorov and Sinai and the newly introduced time-reversed entropy per unit time |45| 

^L=k B (h*-h) (178) 

Here again, the structure is analogue to the one of the relations H174(I - (I176|I because the irreversible property which 
is the entropy production is given as the difference between two dynamical entropies per unit time. Furthermore, in 
Eq. I|178|) . the entropy per unit time is at the same place as the Kolmogorov-Sinai entropy in Eq. (|174fl - l|176|) . The 
structure is also the same as in the fluctuation theorem (|177(l . 

The relationships l|174|) - (|178fl are indeed large-deviation dynamical formulas for the statistical time evolution in 
nonequilibrium conditions. They have the common feature of giving an irreversible property as the difference of two 
large-deviation quantities such as the decay rates of multiple-time probabilities or the growth rates of phase-space 
volumes. Moreover, they are compatible with Liouville's theorem. This is also the case for Jarzynski nonequilibrium 
work theorem ^| and the related Crooks fluctuation theorem [3j|. The discovery of all these new large-deviation 
properties is a major advance in nonequilibrium statistical mechanics during the last fifteen years. 
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